00000080:00200000:0.0F:1782759253.325777:0:84128:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9bdd91595b88),name=/ 00000002:00010000:0.0:1782759253.325831:0:84128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000020:00000040:0.0:1782759253.325852:0:84128:0:(genops.c:1231:class_import_get()) import ffff9bdd85f57800 refcount=5 obd=lustre-MDT0000-mdc-ffff9bdd86bbe000 00000020:00000040:0.0:1782759253.326015:0:84128:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9bdd86401600 with handle 0x4b7c4d35ddf65f4b to hash 00010000:00010000:0.0:1782759253.326028:0:84128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.326040:0:84128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.326054:0:84128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1782759253.326086:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/1152 e 0 to 0 dl 0 ref 2 fl New:QU/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1782759253.326103:0:84128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bdda0105f80 pname:cluuid:pid:xid:nid:opc:job stat:cc46be8c-22cf-4bca-81df-2c76582cdae9:84128:1869355197063424:192.168.204.131@tcp:101:stat.0 00000100:00000040:0.0:1782759253.326144:0:84128:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=600 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/1152 e 0 to 0 dl 1782759269 ref 3 fl Rpc:r/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:0.0:1782759253.326155:0:84128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.131@tcp 00000100:00000040:0.0:1782759253.326229:0:84128:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9bdd86bbe000: using a timeout of 4228 usecs (5 jiffies) 00000100:00100000:0.0:1782759253.326240:0:84128:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bdda0284180 going to sleep for 11 seconds 00000100:00000040:2.0F:1782759253.326372:0:2355:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/1152 e 0 to 0 dl 1782759269 ref 3 fl Rpc:Qr/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:3.0F:1782759253.330861:0:2356:0:(events.c:149:reply_in_callback()) @@@ reply in flags=600 mlen=688 offset=224 replen=1152 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/1152 e 0 to 0 dl 1782759269 ref 2 fl Rpc:RQ/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:1.0F:1782759253.331178:0:84128:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9bdd86bbe000: skip recheck: last_committed 0 00000100:00000040:1.0:1782759253.331269:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/688 e 0 to 0 dl 1782759269 ref 2 fl Rpc:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1782759253.331288:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/688 e 0 to 0 dl 1782759269 ref 2 fl Interpret:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1782759253.331299:0:84128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bdda0105f80 pname:cluuid:pid:xid:nid:opc:job stat:cc46be8c-22cf-4bca-81df-2c76582cdae9:84128:1869355197063424:192.168.204.131@tcp:101:stat.0 00000100:00000040:1.0:1782759253.331314:0:84128:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/688 e 0 to 0 dl 1782759269 ref 2 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1782759253.331551:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=4 00010000:00000040:1.0:1782759253.331564:0:84128:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9bdd86401600, remote cookie: 0xdd99f5c4777dd6bb, flags: 0x1001 00010000:00010000:1.0:1782759253.331573:0:84128:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759253.331587:0:84128:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1782759253.331602:0:84128:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x200000007:0x1:0x0].0x0 (ffff9bdd8abcec00) refcount = 1 00010000:00010000:1.0:1782759253.331607:0:84128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759253.331624:0:84128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1782759253.331633:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00000020:00000040:1.0:1782759253.331636:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=4 00010000:00010000:1.0:1782759253.331642:0:84128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1782759253.331661:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=5 00010000:00010000:1.0:1782759253.331665:0:84128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759253.331673:0:84128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1782759253.331683:0:84128:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/688 e 0 to 0 dl 1782759269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1782759253.331693:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00000020:00000040:1.0:1782759253.331697:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00000002:00010000:1.0:1782759253.331701:0:84128:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1782759253.331708:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00010000:00000040:1.0:1782759253.331715:0:84128:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9bdd8abcec00 count: 2 00010000:00010000:1.0:1782759253.331719:0:84128:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff9bdd860bcc00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1782759253.331727:0:84128:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1782759253.331762:0:84128:0:(llite_lib.c:3013:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000020:00000040:1.0:1782759253.331766:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00000080:00010000:1.0:1782759253.331771:0:84128:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9bdd91595b88) for lock 0x4b7c4d35ddf65f4b 00000020:00000040:1.0:1782759253.331775:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00000080:00010000:1.0:1782759253.331779:0:84128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9bdd91595b88) 00000080:00010000:1.0:1782759253.331783:0:84128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4b7c4d35ddf65f4b from it ffffb534c20abb58 00000020:00000040:1.0:1782759253.331785:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401600 refcount=3 00010000:00010000:1.0:1782759253.331827:0:84128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759253.331860:0:84128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401600/0x4b7c4d35ddf65f4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6bb expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00000040:1.0:1782759253.331881:0:84128:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9bdda0105f80 x1869355197063424/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 576/688 e 0 to 0 dl 1782759269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1782759253.331894:0:84128:0:(genops.c:1244:class_import_put()) import ffff9bdd85f57800 refcount=4 obd=lustre-MDT0000-mdc-ffff9bdd86bbe000 00000080:00200000:1.0:1782759253.331905:0:84128:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9bdd91595b88), inode mode 41ed mask 1 00000080:00200000:0.0:1782759253.331975:0:84128:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d49.sanity-sec, dir=[0x200000007:0x1:0x0](ffff9bdd91595b88), flags=24 00000080:00200000:0.0:1782759253.331983:0:84128:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d49.sanity-sec, dir=[0x200000007:0x1:0x0](ffff9bdd91595b88), intent=0 00000002:00010000:0.0:1782759253.332012:0:84128:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d49.sanity-sec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00000020:00000040:0.0:1782759253.332023:0:84128:0:(genops.c:1231:class_import_get()) import ffff9bdd85f57800 refcount=5 obd=lustre-MDT0000-mdc-ffff9bdd86bbe000 00010000:00000040:0.0:1782759253.332073:0:84128:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9bdd8abcec00 count: 2 00000020:00000040:0.0:1782759253.332082:0:84128:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9bdd86401200 with handle 0x4b7c4d35ddf65f52 to hash 00010000:00010000:0.0:1782759253.332089:0:84128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.332106:0:84128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.332118:0:84128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 84128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1782759253.332152:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/1152 e 0 to 0 dl 0 ref 2 fl New:QU/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1782759253.332167:0:84128:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bdda0107100 pname:cluuid:pid:xid:nid:opc:job stat:cc46be8c-22cf-4bca-81df-2c76582cdae9:84128:1869355197063552:192.168.204.131@tcp:101:stat.0 00000100:00000040:0.0:1782759253.332211:0:84128:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=600 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/1152 e 0 to 0 dl 1782759269 ref 3 fl Rpc:r/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:0.0:1782759253.332222:0:84128:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.131@tcp 00000100:00000040:0.0:1782759253.332307:0:84128:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9bdd86bbe000: using a timeout of 4402 usecs (5 jiffies) 00000100:00100000:0.0:1782759253.332317:0:84128:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bdda0284b40 going to sleep for 11 seconds 00000100:00000040:2.0:1782759253.332910:0:2355:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/1152 e 0 to 0 dl 1782759269 ref 3 fl Rpc:Qr/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:3.0:1782759253.337362:0:2356:0:(events.c:149:reply_in_callback()) @@@ reply in flags=600 mlen=616 offset=224 replen=1152 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/1152 e 0 to 0 dl 1782759269 ref 2 fl Rpc:RQ/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:0.0:1782759253.337699:0:84128:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9bdd86bbe000: skip recheck: last_committed 0 00000100:00000040:0.0:1782759253.337710:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/616 e 0 to 0 dl 1782759269 ref 2 fl Rpc:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000100:00000040:0.0:1782759253.337722:0:84128:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/616 e 0 to 0 dl 1782759269 ref 2 fl Interpret:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1782759253.337730:0:84128:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bdda0107100 pname:cluuid:pid:xid:nid:opc:job stat:cc46be8c-22cf-4bca-81df-2c76582cdae9:84128:1869355197063552:192.168.204.131@tcp:101:stat.0 00000100:00000040:0.0:1782759253.337739:0:84128:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/616 e 0 to 0 dl 1782759269 ref 2 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1782759253.337755:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=4 00010000:00000040:0.0:1782759253.337763:0:84128:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9bdd86401200, remote cookie: 0xdd99f5c4777dd6d7, flags: 0x1001 00010000:00010000:0.0:1782759253.337770:0:84128:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1782759253.337833:0:84128:0:(ldlm_request.c:768:ldlm_cli_enqueue_fini()) remote intent success, locking [0x20000040e:0x1:0x0].0x0, instead of [0x200000007:0x1:0x0].0x0 00010000:00010000:0.0:1782759253.337849:0:84128:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: --/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.337858:0:84128:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: --/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1782759253.337870:0:84128:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x20000040e:0x1:0x0].0x0 (ffff9bdd8abce800) refcount = 1 00010000:00010000:0.0:1782759253.337874:0:84128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.337889:0:84128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1782759253.337900:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00000020:00000040:0.0:1782759253.337912:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=4 00010000:00010000:0.0:1782759253.337917:0:84128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 5/2,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1782759253.337924:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=5 00010000:00010000:0.0:1782759253.337927:0:84128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 5/2,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.337935:0:84128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 4/1,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782759253.337945:0:84128:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/616 e 0 to 0 dl 1782759269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1782759253.337958:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00000020:00000040:0.0:1782759253.337964:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00000002:00010000:0.0:1782759253.337967:0:84128:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 3/1,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1782759253.337978:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00010000:00000040:0.0:1782759253.337982:0:84128:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9bdd8abce800 count: 2 00010000:00010000:0.0:1782759253.337986:0:84128:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff9bdd860bcc00 type 13 mode 4 res 8589935630/1 (0 0) 00000080:00200000:0.0:1782759253.337993:0:84128:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782759253.338013:0:84128:0:(llite_lib.c:3013:ll_update_inode()) inode=[0x20000040e:0x1:0x0], updating i_size 1024 00000080:00200000:0.0:1782759253.338016:0:84128:0:(namei.c:147:ll_iget()) got inode: [0x20000040e:0x1:0x0](ffff9bdd915da1c8): rc = 0 00000020:00000040:0.0:1782759253.338019:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00000080:00010000:0.0:1782759253.338029:0:84128:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x20000040e:0x1:0x0](ffff9bdd915da1c8) for lock 0x4b7c4d35ddf65f52 00000020:00000040:0.0:1782759253.338032:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00000080:00010000:0.0:1782759253.338042:0:84128:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x20000040e:0x1:0x0](ffff9bdd915da1c8) 00000080:00010000:0.0:1782759253.338045:0:84128:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4b7c4d35ddf65f52 from it ffffb534c20aba28 00000020:00000040:0.0:1782759253.338047:0:84128:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9bdd86401200 refcount=3 00010000:00010000:0.0:1782759253.338050:0:84128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 3/1,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759253.338059:0:84128:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9bdd86bbe000 lock: ffff9bdd86401200/0x4b7c4d35ddf65f52 lrc: 2/0,0 mode: PR/PR res: [0x20000040e:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdd99f5c4777dd6d7 expref: -99 pid: 84128 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00000040:0.0:1782759253.338076:0:84128:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9bdda0107100 x1869355197063552/t0(0) o101->lustre-MDT0000-mdc-ffff9bdd86bbe000@192.168.204.131@tcp:12/10 lens 584/616 e 0 to 0 dl 1782759269 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'stat.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1782759253.338087:0:84128:0:(genops.c:1244:class_import_put()) import ffff9bdd85f57800 refcount=4 obd=lustre-MDT0000-mdc-ffff9bdd86bbe000 00000080:00200000:0.0:1782759253.338100:0:84128:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x20000040e:0x1:0x0](ffff9bdd915da1c8), inode mode 41ed mask 1 00000080:00200000:0.0:1782759253.338119:0:84128:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=subdir, dir=[0x20000040e:0x1:0x0](ffff9bdd915da1c8), flags=8 00000080:00200000:0.0:1782759253.338127:0:84128:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=subdir, dir=[0x20000040e:0x1:0x0](ffff9bdd915da1c8), intent=getattr 00000080:00000040:0.0:1782759253.338135:0:84128:0:(dcache.c:176:ll_intent_release()) intent ffffb534c20abb20 released 00000100:00000040:3.0:1782759253.819970:0:70527:0:(connection.c:75:cpu_latency_work()) work item of ffff9bdda0334b30 (cpu 0) has reached its deadline 4297993213, at 4297993216 00000100:00000040:2.0:1782759253.819970:0:82183:0:(connection.c:75:cpu_latency_work()) work item of ffff9bdda0334a20 (cpu 0) has reached its deadline 4297993213, at 4297993216 00000001:02000400:2.0:1782759254.068264:0:84253:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_49: @@@@@@ FAIL: stat /mnt/lustre/d49.sanity-sec/subdir failed 00010000:00010000:1.0:1782759254.076948:0:84085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 118 lines, 118 kept, 0 dropped, 0 bad.