00000080:00200000:2.0F:1787096524.755057:0:27742:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096524.755081:0:27742:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096524.755132:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.755142:0:27742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.755151:0:27742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096524.755175:0:27742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485312:192.168.203.145@tcp:101:rm.0 00000100:00100000:2.0:1787096524.755254:0:27742:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e0d6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096524.756597:0:27742:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485312:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096524.756612:0:27742:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756622:0:27742:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756633:0:27742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756643:0:27742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756653:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756662:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756676:0:27742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096524.756689:0:27742:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c8878a80 x1873906345485312/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096524.756715:0:27742:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756816:0:27742:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1787096524.756822:0:27742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787096524.756909:0:27742:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1787096524.756917:0:27742:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8417 00000080:00010000:2.0:1787096524.756923:0:27742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096524.756926:0:27742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8417 from it ffffa5c141cafb58 00010000:00010000:2.0:1787096524.756931:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.756944:0:27742:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096524.756968:0:27742:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096524.756985:0:27742:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:2.0:1787096524.756989:0:27742:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:2.0:1787096524.757004:0:27742:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096524.757071:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.757090:0:27742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0F:1787096524.757105:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096524.757107:0:27742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096524.757125:0:27742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485440:192.168.203.145@tcp:101:rm.0 00000100:00100000:2.0:1787096524.757186:0:27742:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e0d6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096524.758202:0:27742:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485440:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096524.758215:0:27742:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758228:0:27742:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758234:0:27742:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758239:0:27742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758245:0:27742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758253:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758270:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758277:0:27742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096524.758287:0:27742:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c8878a80 x1873906345485440/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096540 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096524.758297:0:27742:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758303:0:27742:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/16 (0 0) 00000080:00200000:2.0:1787096524.758306:0:27742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096524.758316:0:27742:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x10:0x0], updating i_size 0 00000080:00200000:2.0:1787096524.758318:0:27742:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0x10:0x0](ffff8d25c8d1ec08): rc = 0 00000080:00200000:2.0:1787096524.758355:0:27742:0:(file.c:6803:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787096524.758379:0:27742:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) for lock 0x93bbba3c5a0d841e 00000080:00010000:2.0:1787096524.758393:0:27742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00000080:00010000:2.0:1787096524.758396:0:27742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d841e from it ffffa5c141cafb20 00010000:00010000:2.0:1787096524.758399:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096524.758405:0:27742:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787096524.758425:0:27742:0:(file.c:6271:ll_getattr_dentry()) START file f6e.sanity-ec:[0x200000401:0x10:0x0](ffff8d25c8d1ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096524.758438:0:27742:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08),name=f6e.sanity-ec 00000002:00010000:2.0:1787096524.758447:0:27742:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096524.758453:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096524.758460:0:27742:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096524.758465:0:27742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096524.758467:0:27742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00000080:00010000:2.0:1787096524.758469:0:27742:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) for lock 0x93bbba3c5a0d841e 00000080:00010000:2.0:1787096524.758473:0:27742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d841e from it ffffa5c141cafcb8 00010000:00010000:2.0:1787096524.758476:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096524.758483:0:27742:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096524.758519:0:27742:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096524.758527:0:27742:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096524.758533:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096524.758541:0:27742:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096524.758547:0:27742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096524.758552:0:27742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096524.758559:0:27742:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8417 00000080:00010000:2.0:1787096524.758563:0:27742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8417 from it ffffa5c141cafc10 00010000:00010000:2.0:1787096524.758566:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096524.758573:0:27742:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096524.758583:0:27742:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096524.758591:0:27742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=0 00000080:00200000:2.0:1787096524.758595:0:27742:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096524.758602:0:27742:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096524.758607:0:27742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096524.758614:0:27742:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096524.758619:0:27742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096524.758624:0:27742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096524.758626:0:27742:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8417 00000080:00010000:2.0:1787096524.758630:0:27742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8417 from it ffffa5c141cafd68 00010000:00010000:2.0:1787096524.758632:0:27742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096524.758639:0:27742:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096524.758645:0:27742:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:2.0:1787096524.758656:0:27742:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00010000:00010000:2.0:1787096524.758700:0:27742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096524.758765:0:27742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096524.758805:0:27742:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:2.0:1787096524.758840:0:27742:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096524.758847:0:27742:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096524.758853:0:27742:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787096524.758855:0:27742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872c00/0x93bbba3c5a0d841e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d633759 expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096524.758869:0:27742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872600/0x93bbba3c5a0d8417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d63373d expref: -99 pid: 27742 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1787096524.758886:0:27742:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096524.758892:0:27742:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c8878a80 x1873906345485696/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096524.758906:0:27742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485696:192.168.203.145@tcp:36:rm.0 00000100:00100000:2.0:1787096524.758959:0:27742:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e0d6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096524.760801:0:27742:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27742:1873906345485696:192.168.203.145@tcp:36:rm.0 00000080:00200000:2.0:1787096524.760854:0:27742:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787096524.760869:0:27742:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787096524.760887:0:27742:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00010000:00010000:2.0:1787096525.780969:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096526.804869:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096527.725935:0:28016:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 7: nosync flag on parity mirror prevents resync updates ========================================================== 19:42:07 (1787096527) 00000080:00200000:1.0:1787096527.777952:0:28031:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:1.0:1787096527.777972:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096527.778020:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.778030:0:28031:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.778039:0:28031:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096527.778064:0:28031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345485824:192.168.203.145@tcp:101:lfs.0 00000100:00100000:1.0:1787096527.778150:0:28031:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d0a03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787096527.779345:0:28031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345485824:192.168.203.145@tcp:101:lfs.0 00010000:00010000:1.0:1787096527.779359:0:28031:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779374:0:28031:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779383:0:28031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779390:0:28031:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779397:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779411:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779416:0:28031:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096527.779424:0:28031:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25d8545c00 x1873906345485824/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096543 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787096527.779433:0:28031:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779439:0:28031:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1787096527.779443:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787096527.779461:0:28031:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:1.0:1787096527.779465:0:28031:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8425 00000080:00010000:1.0:1787096527.779469:0:28031:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:1.0:1787096527.779472:0:28031:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8425 from it ffffa5c141c6fb58 00010000:00010000:1.0:1787096527.779474:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779479:0:28031:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096527.779498:0:28031:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:1.0:1787096527.779507:0:28031:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:1.0:1787096527.779510:0:28031:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:1.0:1787096527.779525:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096527.779554:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779560:0:28031:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096527.779565:0:28031:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096527.779574:0:28031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345485952:192.168.203.145@tcp:101:lfs.0 00000100:00100000:1.0:1787096527.779617:0:28031:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d0a03c00 going to sleep for 11 seconds 00000100:00100000:3.0F:1787096527.781103:0:28031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345485952:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096527.781122:0:28031:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781134:0:28031:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781140:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781147:0:28031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781154:0:28031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781160:0:28031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d25ca309400 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096527.781164:0:28031:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781171:0:28031:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781178:0:28031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781182:0:28031:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096527.781187:0:28031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781191:0:28031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309400/0x93bbba3c5a0d842c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096527.781208:0:28031:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8d25d8545c00 x1873906345485952/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096543 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096527.781216:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787096527.781231:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096527.781243:0:28031:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787096527.781251:0:28031:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8425 from it ffffa5c141c6f930 00010000:00010000:3.0:1787096527.781254:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096527.781261:0:28031:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096527.781311:0:28031:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096527.781321:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096527.781327:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096527.781332:0:28031:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096527.781337:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096527.781341:0:28031:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096527.781343:0:28031:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8425 00000080:00010000:3.0:1787096527.781351:0:28031:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8425 from it ffffa5c141c6fbf8 00010000:00010000:3.0:1787096527.781353:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096527.781358:0:28031:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096527.781365:0:28031:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:3.0:1787096527.781372:0:28031:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f7.sanity-ec, flags=777 00000080:00200000:3.0:1787096527.781376:0:28031:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096527.781382:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096527.781389:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096527.781397:0:28031:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096527.781404:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096527.781408:0:28031:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096527.781410:0:28031:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8425 00000080:00010000:3.0:1787096527.781414:0:28031:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8425 from it ffffa5c141c6fb38 00010000:00010000:3.0:1787096527.781417:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096527.781422:0:28031:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787096527.781428:0:28031:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:3.0:1787096527.781601:0:28031:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), file ffff8d25cade7980, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787096527.781607:0:28031:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000002:00010000:3.0:1787096527.781619:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x200000401:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787096527.781628:0:28031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096527.781654:0:28031:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096527.781658:0:28031:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096527.781659:0:28031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633783 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096527.781678:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.781682:0:28031:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096527.781688:0:28031:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096527.781692:0:28031:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f7100 x1873906345486208/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096527.781698:0:28031:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096527.781708:0:28031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486208:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096527.781817:0:28031:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096527.783841:0:28031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486208:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096527.783862:0:28031:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783882:0:28031:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783890:0:28031:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783910:0:28031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783919:0:28031:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783979:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783987:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.783993:0:28031:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096527.784003:0:28031:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8d25c58f7100 x1873906345486208/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096543 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787096527.784016:0:28031:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f7100 x1873906345486208/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096543 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096527.784034:0:28031:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.784042:0:28031:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/17 (0 0) 00000080:00200000:3.0:1787096527.784046:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096527.784054:0:28031:0:(namei.c:1619:ll_create_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000080:00200000:3.0:1787096527.784071:0:28031:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8d25c8d19988) 00000080:00200000:3.0:1787096527.784075:0:28031:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x11:0x0], updating i_size 0 00000080:00200000:3.0:1787096527.784161:0:28031:0:(file.c:6803:ll_layout_conf()) [0x200000401:0x11:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096527.784174:0:28031:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0x11:0x0](ffff8d25c8d19988) 00000080:00010000:3.0:1787096527.784178:0:28031:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff8d25c8d19988) for lock 0x93bbba3c5a0d8433 00000080:00010000:3.0:1787096527.784187:0:28031:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x11:0x0](ffff8d25c8d19988) 00000080:00200008:3.0:1787096527.784199:0:28031:0:(file.c:1058:ll_file_open()) START file f7.sanity-ec:[0x200000401:0x11:0x0](ffff8d25c8d19988), flags 120501 00000002:00100000:3.0:1787096527.784220:0:28031:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f7100 x1873906345486208/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096543 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787096527.784261:0:28031:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8433 from it ffff8d25c889f360 00010000:00010000:3.0:1787096527.784266:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.784274:0:28031:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096527.784290:0:28031:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8d25c8d19988), inode mode 81a4 mask 40 00000080:00200000:3.0:1787096527.784327:0:28031:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8d25c8d19988), inode mode 81a4 mask 2 00000080:00200000:3.0:1787096527.784337:0:28031:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0x11:0x0](ffff8d25c8d19988), xattr lov 00000002:00010000:3.0:1787096527.784351:0:28031:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787096527.784394:0:28031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096527.784401:0:28031:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096527.784411:0:28031:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096527.784418:0:28031:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f5c00 x1873906345486464/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096527.784426:0:28031:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096527.784443:0:28031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f5c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486464:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096527.784586:0:28031:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b69c0 going to sleep for 11 seconds 00000100:00100000:0.0F:1787096527.785963:0:2348:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.145@tcp (source: 12345-192.168.203.145@tcp) 00000100:00100000:1.0:1787096527.786334:0:5552:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353890432 00000100:00100000:1.0:1787096527.786341:0:5552:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353890432 00000100:00100000:1.0:1787096527.786399:0:5552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.145@tcp, seq: 18 00000100:00100000:1.0:1787096527.786410:0:5552:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8d25d92ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:7424:x1873906353890432:12345-192.168.203.145@tcp:104: 00010000:00010000:1.0:1787096527.786424:0:5552:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.786473:0:5552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096527.786481:0:5552:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8d25d92ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:7424:x1873906353890432:12345-192.168.203.145@tcp:104: Request processed in 73us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096527.786488:0:5552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.145@tcp, seq: 18 00010000:00010000:1.0:1787096527.786945:0:5561:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096527.786953:0:5561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.786962:0:5561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217fc00 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:1.0:1787096527.786968:0:5561:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.786984:0:5561:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.786993:0:5561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096527.787043:0:5561:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x11:0x0]: losing layout lock 00010000:00010000:1.0:1787096527.787092:0:5561:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.787099:0:5561:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096527.787120:0:5561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.787128:0:5561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6337b4 expref: -99 pid: 28031 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096527.787147:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096527.787149:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096527.787152:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096527.787167:0:2356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7354022b-ee92-4e63-a611-5f745ec24594:2356:1873906345486592:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787096527.788401:0:2356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7354022b-ee92-4e63-a611-5f745ec24594:2356:1873906345486592:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787096527.790345:0:28031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f5c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486464:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096527.790362:0:28031:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790374:0:28031:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790381:0:28031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790388:0:28031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790394:0:28031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790400:0:28031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217e000 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:2.0:1787096527.790403:0:28031:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790409:0:28031:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790416:0:28031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790433:0:28031:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787096527.790439:0:28031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096527.790445:0:28031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d843a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 28031 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096527.790468:0:28031:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8d25c58f5c00 x1873906345486464/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096543 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787096527.790481:0:28031:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:2.0:1787096527.790488:0:28031:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:2.0:1787096527.790639:0:28031:0:(file.c:448:ll_file_release()) START file f7.sanity-ec:[0x200000401:0x11:0x0](ffff8d25c8d19988), flags 100001 00000002:00100000:2.0:1787096527.790680:0:28031:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8d25c58f7100 x1873906345486208/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096543 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787096527.790690:0:28031:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787096527.790695:0:28031:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c8878e00 x1873906345486848/t0(0) o35->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787096527.790712:0:28031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486848:192.168.203.145@tcp:35:lfs.0 00000100:00100000:2.0:1787096527.791277:0:28031:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d934f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096527.793257:0:28031:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:28031:1873906345486848:192.168.203.145@tcp:35:lfs.0 00000002:00100000:2.0:1787096527.793281:0:28031:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8d25c58f7100 x1873906345486208/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096543 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787096527.829826:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096528.020923:0:2356:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096528.020954:0:2356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2356:1873906345486976:192.168.203.145@tcp:400:kworker.0 00000100:00100000:1.0:1787096528.023010:0:2356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2356:1873906345486976:192.168.203.145@tcp:400:kworker.0 00000001:02000400:1.0:1787096528.322833:0:28159:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_7: @@@@@@ FAIL: create EC file failed 00010000:00010000:1.0:1787096528.853948:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 293 lines, 293 kept, 0 dropped, 0 bad.