00010000:00010000:2.0F:1767316175.295843:0:30377:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1767316175.617060:0:13818:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d8558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efcdf44b-f089-4822-b0f8-a05beb18178a:13818:1853164331492736:192.168.203.101@tcp:400:kworker.0 00000100:00100000:3.0:1767316175.617225:0:13818:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1767316175.617233:0:13818:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d855b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870:13818:1853164331492608:192.168.203.101@tcp:400:kworker.0 00000100:00100000:3.0:1767316175.617281:0:13815:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efcdf44b-f089-4822-b0f8-a05beb18178a:13815:1853164331492864:192.168.203.101@tcp:400:kworker.0 00000100:00100000:3.0:1767316175.622108:0:13818:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d855b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870:13818:1853164331492608:192.168.203.101@tcp:400:kworker.0 00000100:00100000:3.0:1767316175.627752:0:13815:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efcdf44b-f089-4822-b0f8-a05beb18178a:13815:1853164331492864:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316175.630186:0:13818:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d8558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efcdf44b-f089-4822-b0f8-a05beb18178a:13818:1853164331492736:192.168.203.101@tcp:400:kworker.0 00010000:00010000:0.0F:1767316176.320418:0:30378:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316177.343226:0:31069:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316178.367075:0:30377:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0F:1767316179.032053:0:33808:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 20:09:37 (1767316177) 00010000:00010000:1.0:1767316179.395587:0:30378:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1767316179.407236:0:33675:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988),name=/ 00000002:00010000:3.0:1767316179.407276:0:33675:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.407299:0:33675:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.407317:0:33675:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.407326:0:33675:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.407336:0:33675:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) 00000080:00010000:3.0:1767316179.407340:0:33675:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) for lock 0xdb4bedfb3a37e6ba 00000080:00010000:3.0:1767316179.407349:0:33675:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37e6ba from it ffffb60207e7bbb0 00010000:00010000:3.0:1767316179.407354:0:33675:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.407364:0:33675:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.407385:0:33675:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988), inode mode 41ed mask 44 00000080:00200008:3.0:1767316179.407398:0:33675:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9001c9359988), flags 304000 00000080:00200008:3.0:1767316179.407419:0:33675:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9001c9359988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316179.407465:0:33675:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988),name=/ 00000002:00010000:3.0:1767316179.407473:0:33675:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.407481:0:33675:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.407488:0:33675:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.407494:0:33675:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.407498:0:33675:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) 00000080:00010000:3.0:1767316179.407500:0:33675:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) for lock 0xdb4bedfb3a37e6ba 00000080:00010000:3.0:1767316179.407504:0:33675:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37e6ba from it ffffb60207e7bcd8 00010000:00010000:3.0:1767316179.407507:0:33675:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.407514:0:33675:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.407792:0:33675:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988) pos/size0/4096 32bit_api 0 00000080:00200000:3.0:1767316179.407850:0:33675:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:3.0:1767316179.407920:0:33675:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9001c9359988), flags 304000 00000080:00200000:3.0:1767316179.412368:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988),name=/ 00000002:00010000:3.0:1767316179.412407:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.412428:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.412448:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.412806:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.412816:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) 00000080:00010000:3.0:1767316179.412821:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) for lock 0xdb4bedfb3a37e6ba 00000080:00010000:3.0:1767316179.412829:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37e6ba from it ffffb60207edbb58 00010000:00010000:3.0:1767316179.412834:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.412843:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.412863:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988), inode mode 41ed mask 1 00000080:00200000:3.0:1767316179.412882:0:33851:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d1b.sanity-scrub, dir=[0x200000007:0x1:0x0](ffff9001c9359988), flags=8 00000080:00200000:3.0:1767316179.412887:0:33851:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d1b.sanity-scrub, dir=[0x200000007:0x1:0x0](ffff9001c9359988), intent=getattr 00000002:00010000:3.0:1767316179.412904:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d1b.sanity-scrub,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.412962:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 33851 initiator: MDT0 00010000:00010000:3.0:1767316179.412970:0:33851:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00010000:00010000:3.0:1767316179.412981:0:33851:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000100:00100000:3.0:1767316179.413012:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331492992:192.168.203.101@tcp:101:rm.0 00000100:00100000:3.0:1767316179.413217:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c356a600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316179.417103:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331492992:192.168.203.101@tcp:101:rm.0 00010000:00010000:3.0:1767316179.417139:0:33851:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417187:0:33851:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417196:0:33851:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417209:0:33851:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417222:0:33851:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417236:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 5/2,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417244:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 5/2,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417253:0:33851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 4/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767316179.417265:0:33851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9001d855a300 x1853164331492992/t0(0) o101->lustre-MDT0000-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 592/688 e 0 to 0 dl 1767316195 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767316179.417281:0:33851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417292:0:33851:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9001c6472800 type 13 mode 4 res 8589941618/1 (0 0) 00000080:00200000:3.0:1767316179.417300:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767316179.417341:0:33851:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200001b72:0x1:0x0], updating i_size 4096 00000080:00200000:3.0:1767316179.417345:0:33851:0:(namei.c:151:ll_iget()) got inode: [0x200001b72:0x1:0x0](ffff9001c93580c8): rc = 0 00000080:00010000:3.0:1767316179.417352:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) for lock 0xdb4bedfb3a37efb9 00000080:00010000:3.0:1767316179.417368:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) 00000080:00010000:3.0:1767316179.417372:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efb9 from it ffffb60207edbb20 00010000:00010000:3.0:1767316179.417375:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417384:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767316179.417432:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316179.417441:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8),name=d1b.sanity-scrub 00000002:00010000:3.0:1767316179.417470:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200001b72:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.417480:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417491:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.417498:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.417503:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) 00000080:00010000:3.0:1767316179.417506:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) for lock 0xdb4bedfb3a37efb9 00000080:00010000:3.0:1767316179.417510:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efb9 from it ffffb60207edbcb8 00010000:00010000:3.0:1767316179.417513:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.417520:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.418140:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988),name=/ 00000002:00010000:3.0:1767316179.418155:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.418165:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.418183:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.418191:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.418196:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) 00000080:00010000:3.0:1767316179.418200:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) for lock 0xdb4bedfb3a37e6ba 00000080:00010000:3.0:1767316179.418204:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37e6ba from it ffffb60207edbbf8 00010000:00010000:3.0:1767316179.418208:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.418216:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.418224:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988), inode mode 41ed mask 1 00000080:00200000:3.0:1767316179.418233:0:33851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1b.sanity-scrub, flags=266 00000080:00200000:3.0:1767316179.418241:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1767316179.418252:0:33851:0:(file.c:1001:ll_file_open()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), flags 704400 00000080:00200008:3.0:1767316179.418280:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767316179.418284:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8),name=d1b.sanity-scrub 00000002:00010000:3.0:1767316179.418295:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200001b72:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767316179.418301:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.418319:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.418325:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767316179.418329:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) 00000080:00010000:3.0:1767316179.418332:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) for lock 0xdb4bedfb3a37efb9 00000080:00010000:3.0:1767316179.418336:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efb9 from it ffffb60207edbcd8 00010000:00010000:3.0:1767316179.418339:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.418345:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767316179.418435:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8) pos/size0/4096 32bit_api 0 00000002:00010000:3.0:1767316179.418452:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200001b72:0x1:0x0]) in obj [0x200001b72:0x1:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767316179.418459:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316179.418468:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767316179.419485:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493120:192.168.203.101@tcp:37:rm.0 00000100:00100000:3.0:1767316179.420253:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c356a600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316179.429295:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d855a300 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493120:192.168.203.101@tcp:37:rm.0 00010000:00010000:0.0:1767316179.430346:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.430371:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316179.430729:0:33851:0:(file.c:424:ll_file_release()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), flags 704000 00010000:00010000:0.0:1767316179.430765:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8312e00/0xdb4bedfb3a37e6d6 lrc: 2/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cc5f expref: -99 pid: 30844 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.430912:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988),name=/ 00000002:00010000:0.0:1767316179.430934:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316179.430945:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.430955:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.430963:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316179.430970:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) 00000080:00010000:0.0:1767316179.430974:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9001c9359988) for lock 0xdb4bedfb3a37e6ba 00000080:00010000:0.0:1767316179.430981:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37e6ba from it ffffb60207edbbf8 00010000:00010000:0.0:1767316179.430984:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.430993:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8313000/0xdb4bedfb3a37e6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cbe1 expref: -99 pid: 30413 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.431018:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9001c9359988), inode mode 41ed mask 1 00000080:00200000:0.0:1767316179.431027:0:33851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1b.sanity-scrub, flags=266 00000080:00200000:0.0:1767316179.431034:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767316179.431043:0:33851:0:(file.c:1001:ll_file_open()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), flags 704400 00000080:00200008:0.0:1767316179.431067:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316179.431073:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8),name=d1b.sanity-scrub 00000002:00010000:0.0:1767316179.431088:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200001b72:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316179.431095:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.431104:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.431110:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316179.431114:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) 00000080:00010000:0.0:1767316179.431117:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200001b72:0x1:0x0](ffff9001c93580c8) for lock 0xdb4bedfb3a37efb9 00000080:00010000:0.0:1767316179.431121:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efb9 from it ffffb60207edbcd8 00010000:00010000:0.0:1767316179.431123:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.431131:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.431217:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1767316179.431245:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1767316179.431259:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316179.431271:0:33851:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=mds2, dir=[0x200001b72:0x1:0x0](ffff9001c93580c8), flags=0 00000080:00200000:0.0:1767316179.431280:0:33851:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=mds2, dir=[0x200001b72:0x1:0x0](ffff9001c93580c8), intent=getattr 00000002:00010000:0.0:1767316179.431294:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds2,[0x0:0x0:0x0]) in obj [0x200001b72:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316179.431354:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 33851 initiator: MDT0 00010000:00010000:0.0:1767316179.431363:0:33851:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00010000:00010000:0.0:1767316179.431374:0:33851:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000100:00100000:0.0:1767316179.431406:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d83dfb80 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493248:192.168.203.101@tcp:101:rm.0 00000100:00100000:0.0:1767316179.431727:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001e056f900 going to sleep for 11 seconds 00000100:00100000:2.0:1767316179.437895:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d83dfb80 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493248:192.168.203.101@tcp:101:rm.0 00010000:00010000:2.0:1767316179.437930:0:33851:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.437959:0:33851:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.437967:0:33851:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.437981:0:33851:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.437993:0:33851:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.438005:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 5/2,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.438014:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 5/2,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.438022:0:33851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316179.438035:0:33851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9001d83dfb80 x1853164331493248/t0(0) o101->lustre-MDT0000-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316195 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316179.438049:0:33851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.438080:0:33851:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9001c6472800 type 13 mode 4 res 9663681441/1 (0 0) 00000002:00010000:2.0:1767316179.438102:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x2400013a1:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316179.438160:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.438167:0:33851:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.438188:0:33851:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000100:00100000:2.0:1767316179.438212:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c5b35180 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493376:192.168.203.101@tcp:101:rm.0 00000100:00100000:2.0:1767316179.438356:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c727b600 going to sleep for 11 seconds 00000100:00100000:2.0:1767316179.441490:0:33851:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9001d860d800: committing for last_committed 17179869283 gen 1 00000100:00100000:2.0:1767316179.441517:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c5b35180 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493376:192.168.203.101@tcp:101:rm.0 00010000:00010000:2.0:1767316179.441917:0:33851:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.441933:0:33851:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 4/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.441947:0:33851:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.441960:0:33851:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.441973:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 5/2,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442000:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 5/2,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442008:0:33851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 4/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316179.442020:0:33851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9001c5b35180 x1853164331493376/t0(0) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 576/688 e 0 to 0 dl 1767316195 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767316179.442038:0:33851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442054:0:33851:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9001c6472000 type 13 mode 4 res 9663681441/1 (0 0) 00000080:00200000:2.0:1767316179.442079:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200001b72:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767316179.442120:0:33851:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x2400013a1:0x1:0x0], updating i_size 4096 00000080:00200000:2.0:1767316179.442124:0:33851:0:(namei.c:151:ll_iget()) got inode: [0x2400013a1:0x1:0x0](ffff9001d11bf448): rc = 0 00000080:00010000:2.0:1767316179.442133:0:33851:0:(llite_internal.h:1996:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for remote lock 0xdb4bedfb3a37efc7 00000080:00010000:2.0:1767316179.442138:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for lock 0xdb4bedfb3a37efc0 00000080:00010000:2.0:1767316179.442151:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) 00000080:00010000:2.0:1767316179.442156:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efc0 from it ffffb60207edbb20 00010000:00010000:2.0:1767316179.442160:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442169:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1767316179.442199:0:33851:0:(dcache.c:164:ll_intent_drop_lock()) releasing remote lock with cookie 0xdb4bedfb3a37efc7 from it ffffb60207edbb20 00010000:00010000:2.0:1767316179.442202:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442214:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767316179.442248:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767316179.442910:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448),name=mds2 00000002:00010000:2.0:1767316179.442942:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2400013a1:0x1:0x0]) in obj [0x200001b72:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767316179.442955:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.442968:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316179.442975:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200001b72:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767316179.442982:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) 00000080:00010000:2.0:1767316179.442985:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for lock 0xdb4bedfb3a37efc7 00000080:00010000:2.0:1767316179.442990:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efc7 from it ffffb60207edbcb8 00010000:00010000:2.0:1767316179.442994:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.443001:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316179.443064:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767316179.443071:0:33851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=mds2, flags=258 00000080:00200000:2.0:1767316179.443082:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448), inode mode 41ed mask 44 00000080:00200008:2.0:1767316179.443092:0:33851:0:(file.c:1001:ll_file_open()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), flags 704400 00000002:00010000:2.0:1767316179.443110:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2400013a1:0x1:0x0]) in obj [0x200001b72:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1767316179.443193:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.443202:0:33851:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000020:00100000:2.0:1767316179.443216:0:33851:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9001d860d800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767316179.443227:0:33851:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9001c5b35180 x1853164331493632/t0(0) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767316179.443238:0:33851:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000100:00100000:2.0:1767316179.443264:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c5b35180 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493632:192.168.203.101@tcp:101:rm.0 00000100:00100000:2.0:1767316179.443649:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c727b600 going to sleep for 11 seconds 00000100:00100000:0.0:1767316179.447211:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c5b35180 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493632:192.168.203.101@tcp:101:rm.0 00010000:00010000:0.0:1767316179.447264:0:33851:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447276:0:33851:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447290:0:33851:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 4/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447302:0:33851:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 4/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316179.447318:0:33851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff9001c5b35180 x1853164331493632/t17179869284(17179869284) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 648/664 e 0 to 0 dl 1767316195 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767316179.447333:0:33851:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9001c5b35180 x1853164331493632/t17179869284(17179869284) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 648/664 e 0 to 0 dl 1767316195 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767316179.447378:0:33851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447391:0:33851:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff9001c6472000 type 13 mode 16 res 9663681441/1 (0 0) 00000080:00200000:0.0:1767316179.447399:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200001b72:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767316179.447433:0:33851:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x2400013a1:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767316179.447442:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for lock 0xdb4bedfb3a37efce 00000080:00010000:0.0:1767316179.447451:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efce from it ffffb60207edbbd0 00010000:00010000:0.0:1767316179.447455:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447465:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767316179.447498:0:33851:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9001c5b35180 x1853164331493632/t17179869284(17179869284) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316195 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1767316179.447671:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316179.447681:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448),name=mds2 00000002:00010000:0.0:1767316179.447707:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2400013a1:0x1:0x0]) in obj [0x200001b72:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316179.447718:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447730:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.447737:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200001b72:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316179.447743:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) 00000080:00010000:0.0:1767316179.447754:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for lock 0xdb4bedfb3a37efc7 00000080:00010000:0.0:1767316179.447759:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efc7 from it ffffb60207edbcd8 00010000:00010000:0.0:1767316179.447762:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447769:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.447800:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767316179.447815:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2400013a1:0x1:0x0]) in obj [0x2400013a1:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767316179.447821:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.447829:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316179.448522:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493760:192.168.203.101@tcp:37:rm.0 00000100:00100000:0.0:1767316179.448691:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001e056f540 going to sleep for 11 seconds 00000100:00100000:0.0:1767316179.457860:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493760:192.168.203.101@tcp:37:rm.0 00010000:00010000:0.0:1767316179.458590:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.458608:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767316179.458681:0:33851:0:(file.c:424:ll_file_release()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), flags 704000 00010000:00010000:0.0:1767316179.458715:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.458791:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767316179.458801:0:33851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=mds2, flags=258 00000080:00200000:0.0:1767316179.458809:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448), inode mode 41ed mask 44 00000080:00200008:0.0:1767316179.458817:0:33851:0:(file.c:1001:ll_file_open()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), flags 704400 00000080:00200008:0.0:1767316179.458841:0:33851:0:(file.c:6252:ll_getattr_dentry()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767316179.458848:0:33851:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448),name=mds2 00000002:00010000:0.0:1767316179.458872:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2400013a1:0x1:0x0]) in obj [0x200001b72:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767316179.458882:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.458891:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.458899:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200001b72:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767316179.458905:0:33851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) 00000080:00010000:0.0:1767316179.458909:0:33851:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x2400013a1:0x1:0x0](ffff9001d11bf448) for lock 0xdb4bedfb3a37efc7 00000080:00010000:0.0:1767316179.458916:0:33851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xdb4bedfb3a37efc7 from it ffffb60207edbcd8 00010000:00010000:0.0:1767316179.458919:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.458927:0:33851:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767316179.458956:0:33851:0:(llite_lib.c:2766:ll_statfs()) VFS Op:sb=lustre (ffff9001d860d800) mds2 proj=0 00000080:00000004:0.0:1767316179.458961:0:33851:0:(obd_class.h:1083:obd_statfs()) lustre-clilmv-ffff9001d860d800: age 1375, max_age 1382 00800000:00000004:0.0:1767316179.458972:0:33851:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0000-mdc-ffff9001d860d800: age 1375, max_age 1382 00000100:00100000:0.0:1767316179.459016:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493888:192.168.203.101@tcp:41:rm.0 00000100:00100000:0.0:1767316179.459122:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001e056f480 going to sleep for 11 seconds 00000100:00100000:0.0:1767316179.462998:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331493888:192.168.203.101@tcp:41:rm.0 00800000:00000004:0.0:1767316179.463038:0:33851:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0000-mdc-ffff9001d860d800: update ffff9001c4998370 cache blocks 142191/156552 objects 199263/199801 00000080:00000004:0.0:1767316179.463047:0:33851:0:(obd_class.h:1109:obd_statfs()) lustre-clilmv-ffff9001d860d800: update ffff9001c499b520 cache blocks 142191/156552 objects 199263/199801 00000080:00000004:0.0:1767316179.463053:0:33851:0:(llite_lib.c:2629:ll_statfs_internal()) MDC blocks 142191/156552 objects 199263/199801 00000080:00200000:1.0:1767316179.463205:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1767316179.463258:0:33851:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1767316179.463292:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x2400013a1:0x1:0x0](ffff9001d11bf448), inode mode 41ed mask 1 00000080:00200000:1.0:1767316179.463319:0:33851:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=runas, dir=[0x2400013a1:0x1:0x0](ffff9001d11bf448), flags=0 00000080:00200000:1.0:1767316179.463325:0:33851:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=runas, dir=[0x2400013a1:0x1:0x0](ffff9001d11bf448), intent=getattr 00000002:00010000:1.0:1767316179.463360:0:33851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: runas,[0x0:0x0:0x0]) in obj [0x2400013a1:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767316179.463442:0:33851:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 33851 initiator: MDT0 00010000:00010000:1.0:1767316179.463455:0:33851:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00010000:00010000:1.0:1767316179.463466:0:33851:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00000100:00100000:1.0:1767316179.463496:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c728ea00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494016:192.168.203.101@tcp:101:rm.0 00000100:00100000:1.0:1767316179.464106:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c755acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1767316179.467903:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c728ea00 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494016:192.168.203.101@tcp:101:rm.0 00010000:00010000:2.0:1767316179.467933:0:33851:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.467948:0:33851:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.467954:0:33851:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.467962:0:33851:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 3/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.467971:0:33851:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.467977:0:33851:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9001d8129c00 already unused, calling callback (ffffffffc1913b40) 00010000:00010000:2.0:1767316179.467999:0:33851:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.468007:0:33851:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 4/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.468015:0:33851:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 5/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.468022:0:33851:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767316179.468030:0:33851:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 3/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 33851 initiator: MDT0 00010000:00010000:2.0:1767316179.468036:0:33851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001d8129c00/0xdb4bedfb3a37efd5 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 33851 initiator: MDT0 00000002:00100000:2.0:1767316179.468059:0:33851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=-2 req@ffff9001c728ea00 x1853164331494016/t0(0) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 576/584 e 0 to 0 dl 1767316195 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767316179.468074:0:33851:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x2400013a1:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200008:2.0:1767316179.468150:0:33851:0:(file.c:424:ll_file_release()) START file mds2:[0x2400013a1:0x1:0x0](ffff9001d11bf448), flags 704000 00010000:00010000:2.0:1767316179.468204:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767316179.468243:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767316179.468255:0:33851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=mds2, flags=0 00000080:00200000:2.0:1767316179.468264:0:33851:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200001b72:0x1:0x0](ffff9001c93580c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767316179.468270:0:33851:0:(namei.c:2264:ll_rmdir()) VFS Op:name=mds2, dir=[0x200001b72:0x1:0x0](ffff9001c93580c8) 00010000:00010000:2.0:1767316179.468299:0:33851:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.468349:0:33851:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 1/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.468368:0:33851:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1767316179.468454:0:13816:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c5b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331494144:192.168.203.101@tcp:103:rm.0 00010000:00010000:2.0:1767316179.469126:0:33851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c6744c00/0xdb4bedfb3a37efc0 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc39 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.469165:0:33851:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767316179.469229:0:33851:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9001c5b35180 x1853164331493632/t17179869284(17179869284) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316195 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767316179.469242:0:33851:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9001d860d800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767316179.469248:0:33851:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9001c5b36680 x1853164331494400/t0(0) o35->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767316179.469269:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c5b36680 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494400:192.168.203.101@tcp:35:rm.0 00000100:00100000:2.0:1767316179.469369:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c727b600 going to sleep for 11 seconds 00000100:00100000:2.0:1767316179.472727:0:13816:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c5b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331494144:192.168.203.101@tcp:103:rm.0 00000100:00100000:3.0:1767316179.474442:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c5b36680 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494400:192.168.203.101@tcp:35:rm.0 00000002:00100000:3.0:1767316179.474490:0:33851:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9001c5b35180 x1853164331493632/t17179869284(17179869284) o101->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 520/664 e 0 to 0 dl 1767316195 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767316179.475100:0:33851:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.475573:0:33851:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 1/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.475584:0:33851:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 1/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.475589:0:33851:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767316179.475592:0:33851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cc800/0xdb4bedfb3a37efce lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc55 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316179.475603:0:33851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9001d860d800 lock: ffff9001c29cda00/0xdb4bedfb3a37efc7 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1c4382d255f6fc47 expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767316179.475647:0:33851:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9001d860d800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767316179.475659:0:33851:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9001c5b35f80 x1853164331494656/t0(0) o36->lustre-MDT0001-mdc-ffff9001d860d800@192.168.203.101@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767316179.475686:0:33851:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c5b35f80 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494656:192.168.203.101@tcp:36:rm.0 00000100:00100000:2.0:1767316179.475809:0:33851:0:(client.c:2690:ptlrpc_set_wait()) set ffff9001c727b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316179.478635:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.101@tcp (source: 12345-192.168.203.101@tcp) 00000100:00100000:0.0:1767316179.478820:0:31063:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419087488 00000100:00100000:0.0:1767316179.478832:0:31063:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419087488 00000100:00100000:0.0:1767316179.478901:0:31063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.101@tcp, seq: 123 00000100:00100000:0.0:1767316179.478912:0:31063:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9001c728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+5:44074:x1853164419087488:12345-192.168.203.101@tcp:104: 00010000:00010000:0.0:1767316179.478932:0:31063:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479029:0:31063:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1767316179.479036:0:31063:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9001c728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+5:44074:x1853164419087488:12345-192.168.203.101@tcp:104: Request processed in 126us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316179.479044:0:31063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.101@tcp, seq: 123 00010000:00010000:0.0:1767316179.479069:0:31069:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316179.479075:0:31069:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479084:0:31069:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9001c755c200 already unused, calling callback (ffffffffc1913b40) 00010000:00010000:0.0:1767316179.479089:0:31069:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479098:0:31069:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479121:0:31069:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479155:0:31069:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8312e00/0xdb4bedfb3a37e6d6 lrc: 2/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cc5f expref: -99 pid: 30844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479221:0:31069:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 2/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479228:0:31069:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316179.479256:0:31069:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 1/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479263:0:31069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001c755c200/0xdb4bedfb3a37efb9 lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x13 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x1c4382d255f6fc1d expref: -99 pid: 33851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316179.479278:0:31069:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316179.479280:0:31069:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316179.479282:0:31069:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316179.479301:0:13817:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efcdf44b-f089-4822-b0f8-a05beb18178a:13817:1853164331494784:192.168.203.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316179.485955:0:13817:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001d83dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efcdf44b-f089-4822-b0f8-a05beb18178a:13817:1853164331494784:192.168.203.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767316179.491004:0:33851:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c5b35f80 pname:cluuid:pid:xid:nid:opc:job rm:efcdf44b-f089-4822-b0f8-a05beb18178a:33851:1853164331494656:192.168.203.101@tcp:36:rm.0 00000080:00200008:2.0:1767316179.491541:0:33851:0:(file.c:424:ll_file_release()) START file d1b.sanity-scrub:[0x200001b72:0x1:0x0](ffff9001c93580c8), flags 704000 00010000:00010000:2.0:1767316179.491648:0:33851:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9001d860d800 lock: ffff9001d8312e00/0xdb4bedfb3a37e6d6 lrc: 2/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1c4382d255f6cc5f expref: -99 pid: 30844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316180.417668:0:30377:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316180.735707:0:13817:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1767316180.735740:0:13817:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870:13817:1853164331494912:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316180.735895:0:13816:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c728c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331495168:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316180.735925:0:13816:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316180.735930:0:13816:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9001c728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331495040:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316180.738798:0:13816:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331495040:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316180.738821:0:13816:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c728c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efcdf44b-f089-4822-b0f8-a05beb18178a:13816:1853164331495168:192.168.203.101@tcp:400:kworker.0 00000100:00100000:2.0:1767316180.747449:0:13817:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9001c728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870:13817:1853164331494912:192.168.203.101@tcp:400:kworker.0 00000001:02000400:3.0:1767316181.032450:0:33980:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_4d: @@@@@@ FAIL: Fail to cleanup the env! 00010000:00010000:1.0:1767316181.446661:0:30378:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316182.462752:0:31069:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 384 lines, 384 kept, 0 dropped, 0 bad.