00000080:00200000:0.0F:1787096520.392883:0:27020:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:0.0:1787096520.392908:0:27020:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096520.392962:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096520.392972:0:27020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096520.392983:0:27020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096520.393005:0:27020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d92ef100 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483392:192.168.203.145@tcp:101:rm.0 00000100:00100000:0.0:1787096520.393079:0:27020:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e0d6a900 going to sleep for 11 seconds 00000100:00100000:1.0F:1787096520.394655:0:27020:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d92ef100 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483392:192.168.203.145@tcp:101:rm.0 00010000:00010000:1.0:1787096520.394683:0:27020:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394695:0:27020:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394706:0:27020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394718:0:27020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394746:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394755:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394763:0:27020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096520.394783:0:27020:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25d92ef100 x1873906345483392/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096536 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787096520.394796:0:27020:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394806:0:27020:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1787096520.394811:0:27020:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787096520.394839:0:27020:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:1.0:1787096520.394846:0:27020:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83ed 00000080:00010000:1.0:1787096520.394851:0:27020:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:1.0:1787096520.394854:0:27020:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83ed from it ffffa5c141d8fb58 00010000:00010000:1.0:1787096520.394858:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394867:0:27020:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096520.394888:0:27020:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:1.0:1787096520.394904:0:27020:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:1.0:1787096520.394909:0:27020:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:1.0:1787096520.394923:0:27020:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096520.394949:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394956:0:27020:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096520.394964:0:27020:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096520.394978:0:27020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8547480 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483520:192.168.203.145@tcp:101:rm.0 00000100:00100000:1.0:1787096520.395030:0:27020:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25cac37a80 going to sleep for 11 seconds 00000100:00100000:2.0F:1787096520.396504:0:27020:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8547480 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483520:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096520.396525:0:27020:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396543:0:27020:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396551:0:27020:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396560:0:27020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396569:0:27020:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396579:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396587:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396594:0:27020:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096520.396604:0:27020:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25d8547480 x1873906345483520/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096536 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096520.396615:0:27020:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396641:0:27020:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/15 (0 0) 00000080:00200000:2.0:1787096520.396646:0:27020:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096520.396663:0:27020:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xf:0x0], updating i_size 0 00000080:00200000:2.0:1787096520.396666:0:27020:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0xf:0x0](ffff8d25c8d1cb08): rc = 0 00000080:00200000:2.0:1787096520.396702:0:27020:0:(file.c:6803:ll_layout_conf()) [0x200000401:0xf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787096520.396758:0:27020:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xf:0x0](ffff8d25c8d1cb08) for lock 0x93bbba3c5a0d83f4 00000080:00010000:2.0:1787096520.396768:0:27020:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xf:0x0](ffff8d25c8d1cb08) 00000080:00010000:2.0:1787096520.396785:0:27020:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83f4 from it ffffa5c141d8fb20 00010000:00010000:2.0:1787096520.396788:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096520.396797:0:27020:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787096520.396825:0:27020:0:(file.c:6271:ll_getattr_dentry()) START file f6d.sanity-ec:[0x200000401:0xf:0x0](ffff8d25c8d1cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096520.396831:0:27020:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xf:0x0](ffff8d25c8d1cb08),name=f6d.sanity-ec 00000002:00010000:2.0:1787096520.396843:0:27020:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096520.396852:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096520.396862:0:27020:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096520.396870:0:27020:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096520.396874:0:27020:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xf:0x0](ffff8d25c8d1cb08) 00000080:00010000:2.0:1787096520.396878:0:27020:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xf:0x0](ffff8d25c8d1cb08) for lock 0x93bbba3c5a0d83f4 00000080:00010000:2.0:1787096520.396894:0:27020:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83f4 from it ffffa5c141d8fcb8 00010000:00010000:2.0:1787096520.396897:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096520.396906:0:27020:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096520.396943:0:27020:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096520.396950:0:27020:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096520.396957:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096520.396965:0:27020:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096520.396972:0:27020:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096520.396976:0:27020:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096520.396979:0:27020:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83ed 00000080:00010000:2.0:1787096520.396982:0:27020:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83ed from it ffffa5c141d8fc10 00010000:00010000:2.0:1787096520.396985:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096520.396992:0:27020:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096520.397000:0:27020:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096520.397007:0:27020:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6d.sanity-ec, flags=0 00000080:00200000:2.0:1787096520.397011:0:27020:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096520.397022:0:27020:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096520.397027:0:27020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096520.397036:0:27020:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096520.397043:0:27020:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096520.397046:0:27020:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096520.397049:0:27020:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83ed 00000080:00010000:2.0:1787096520.397052:0:27020:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83ed from it ffffa5c141d8fd68 00010000:00010000:2.0:1787096520.397055:0:27020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096520.397064:0:27020:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096520.397072:0:27020:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:2.0:1787096520.397077:0:27020:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00010000:00010000:2.0:1787096520.397113:0:27020:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096520.397146:0:27020:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096520.397165:0:27020:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xf:0x0]: losing layout lock 00010000:00010000:2.0:1787096520.397194:0:27020:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096520.397212:0:27020:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096520.397225:0:27020:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787096520.397228:0:27020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309c00/0x93bbba3c5a0d83f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d6336bf expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096520.397242:0:27020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c0031000/0x93bbba3c5a0d83ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6336a3 expref: -99 pid: 27020 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1787096520.397261:0:27020:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096520.397267:0:27020:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887a680 x1873906345483776/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096520.397285:0:27020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887a680 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483776:192.168.203.145@tcp:36:rm.0 00000100:00100000:2.0:1787096520.397340:0:27020:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d0a39780 going to sleep for 11 seconds 00000100:00100000:2.0:1787096520.400099:0:27020:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887a680 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:27020:1873906345483776:192.168.203.145@tcp:36:rm.0 00000080:00200000:2.0:1787096520.400168:0:27020:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0xf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787096520.400177:0:27020:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787096520.400194:0:27020:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0xf:0x0](ffff8d25c8d1cb08) 00010000:00010000:2.0:1787096520.660942:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1787096521.685037:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096522.708811:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096522.900869:0:2356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2356:1873906345483904:192.168.203.145@tcp:400:kworker.0 00000100:00100000:0.0:1787096522.900961:0:2356:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096522.900969:0:2356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7354022b-ee92-4e63-a611-5f745ec24594:2356:1873906345484032:192.168.203.145@tcp:400:kworker.0 00000100:00100000:1.0:1787096522.901771:0:2356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2356:1873906345483904:192.168.203.145@tcp:400:kworker.0 00000100:00100000:1.0:1787096522.901844:0:2356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7354022b-ee92-4e63-a611-5f745ec24594:2356:1873906345484032:192.168.203.145@tcp:400:kworker.0 00000001:02000400:3.0:1787096523.095522:0:27300:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 19:42:02 (1787096522) 00000080:00200000:3.0:1787096523.171945:0:27318:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096523.171968:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096523.172020:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.172030:0:27318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.172038:0:27318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096523.172061:0:27318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484160:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096523.172136:0:27318:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c51860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096523.173463:0:27318:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8d25d82bf800: committing for last_committed 4294967347 gen 1 00000100:00100000:3.0:1787096523.173486:0:27318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484160:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096523.173499:0:27318:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173508:0:27318:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173519:0:27318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173529:0:27318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173551:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173558:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173566:0:27318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096523.173577:0:27318:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c58f6a00 x1873906345484160/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096539 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096523.173589:0:27318:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173598:0:27318:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1787096523.173603:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787096523.173623:0:27318:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:3.0:1787096523.173628:0:27318:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83fb 00000080:00010000:3.0:1787096523.173633:0:27318:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096523.173637:0:27318:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83fb from it ffffa5c141ec7b58 00010000:00010000:3.0:1787096523.173640:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173647:0:27318:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096523.173674:0:27318:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:3.0:1787096523.173687:0:27318:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:3.0:1787096523.173691:0:27318:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:3.0:1787096523.173704:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096523.173749:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173771:0:27318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.173778:0:27318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096523.173792:0:27318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484288:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096523.173830:0:27318:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c51860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096523.175229:0:27318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484288:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096523.175239:0:27318:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175249:0:27318:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175255:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175261:0:27318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175278:0:27318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175284:0:27318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217f800 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096523.175287:0:27318:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175293:0:27318:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175300:0:27318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175306:0:27318:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096523.175311:0:27318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175317:0:27318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096523.175331:0:27318:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8d25c58f6a00 x1873906345484288/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096539 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096523.175341:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787096523.175356:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096523.175366:0:27318:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787096523.175373:0:27318:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83fb from it ffffa5c141ec7930 00010000:00010000:3.0:1787096523.175382:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096523.175389:0:27318:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096523.175441:0:27318:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096523.175450:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096523.175456:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096523.175464:0:27318:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096523.175470:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096523.175474:0:27318:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096523.175477:0:27318:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83fb 00000080:00010000:3.0:1787096523.175481:0:27318:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83fb from it ffffa5c141ec7bf8 00010000:00010000:3.0:1787096523.175483:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096523.175490:0:27318:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096523.175498:0:27318:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:3.0:1787096523.175505:0:27318:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=777 00000080:00200000:3.0:1787096523.175509:0:27318:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096523.175514:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096523.175519:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096523.175533:0:27318:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096523.175539:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096523.175543:0:27318:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096523.175545:0:27318:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d83fb 00000080:00010000:3.0:1787096523.175549:0:27318:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d83fb from it ffffa5c141ec7b38 00010000:00010000:3.0:1787096523.175551:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096523.175558:0:27318:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787096523.175566:0:27318:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:3.0:1787096523.175571:0:27318:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), file ffff8d25c4d36300, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787096523.175578:0:27318:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000002:00010000:3.0:1787096523.175592:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x200000401:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787096523.175610:0:27318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096523.175643:0:27318:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096523.175650:0:27318:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096523.175652:0:27318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d83fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6336e9 expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096523.175687:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.175693:0:27318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096523.175702:0:27318:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096523.175708:0:27318:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f6a00 x1873906345484544/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096523.175716:0:27318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096523.176079:0:27318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484544:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096523.176164:0:27318:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c51860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096523.179065:0:27318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f6a00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484544:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096523.179087:0:27318:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179115:0:27318:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179123:0:27318:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179134:0:27318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179198:0:27318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179211:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179218:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179224:0:27318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096523.179236:0:27318:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8d25c58f6a00 x1873906345484544/t4294967348(4294967348) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787096523.179247:0:27318:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f6a00 x1873906345484544/t4294967348(4294967348) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096523.179258:0:27318:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179268:0:27318:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/16 (0 0) 00000080:00200000:3.0:1787096523.179274:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096523.179283:0:27318:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000080:00200000:3.0:1787096523.179308:0:27318:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00000080:00200000:3.0:1787096523.179313:0:27318:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x10:0x0], updating i_size 0 00000080:00200000:3.0:1787096523.179390:0:27318:0:(file.c:6803:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096523.179400:0:27318:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00000080:00010000:3.0:1787096523.179412:0:27318:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) for lock 0x93bbba3c5a0d8409 00000080:00010000:3.0:1787096523.179421:0:27318:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff8d25c8d1ec08) 00000080:00200008:3.0:1787096523.179433:0:27318:0:(file.c:1058:ll_file_open()) START file f6e.sanity-ec:[0x200000401:0x10:0x0](ffff8d25c8d1ec08), flags 120501 00000002:00100000:3.0:1787096523.179450:0:27318:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f6a00 x1873906345484544/t4294967348(4294967348) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096539 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787096523.179482:0:27318:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8409 from it ffff8d25c889f300 00010000:00010000:3.0:1787096523.179486:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179494:0:27318:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096523.179512:0:27318:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787096523.179552:0:27318:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787096523.179560:0:27318:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0x10:0x0](ffff8d25c8d1ec08), xattr lov 00000002:00010000:3.0:1787096523.179573:0:27318:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787096523.179626:0:27318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.179633:0:27318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096523.179642:0:27318:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096523.179647:0:27318:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f4e00 x1873906345484800/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096523.179656:0:27318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096523.179672:0:27318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f4e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484800:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096523.179859:0:27318:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c5186780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096523.180628:0:2348:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.145@tcp (source: 12345-192.168.203.145@tcp) 00000100:00100000:0.0:1787096523.180679:0:5551:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353889280 00000100:00100000:0.0:1787096523.180685:0:5551:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353889280 00000100:00100000:0.0:1787096523.180716:0:5551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.145@tcp, seq: 17 00000100:00100000:0.0:1787096523.180741:0:5551:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8d25d8544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353889280:12345-192.168.203.145@tcp:104: 00010000:00010000:0.0:1787096523.180761:0:5551:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096523.180804:0:5551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787096523.180810:0:5551:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8d25d8544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353889280:12345-192.168.203.145@tcp:104: Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096523.180817:0:5551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.145@tcp, seq: 17 00010000:00010000:2.0:1787096523.180837:0:5562:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096523.180845:0:5562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096523.180855:0:5562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217fc00 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:2.0:1787096523.180866:0:5562:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096523.180875:0:5562:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096523.180883:0:5562:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096523.180915:0:5562:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:2.0:1787096523.180952:0:5562:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096523.180959:0:5562:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096523.180983:0:5562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787096523.180986:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345484928:192.168.203.145@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096523.180996:0:5562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d63371a expref: -99 pid: 27318 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096523.181013:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096523.181017:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096523.181020:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096523.181798:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345484928:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787096523.182186:0:27318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f4e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345484800:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096523.182194:0:27318:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182200:0:27318:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182204:0:27318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182208:0:27318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182212:0:27318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182215:0:27318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217e000 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096523.182217:0:27318:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182220:0:27318:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182223:0:27318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182242:0:27318:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096523.182245:0:27318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096523.182249:0:27318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e000/0x93bbba3c5a0d8410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27318 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096523.182262:0:27318:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8d25c58f4e00 x1873906345484800/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096539 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096523.182269:0:27318:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:3.0:1787096523.182273:0:27318:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:3.0:1787096523.182417:0:27318:0:(file.c:448:ll_file_release()) START file f6e.sanity-ec:[0x200000401:0x10:0x0](ffff8d25c8d1ec08), flags 100001 00000002:00100000:3.0:1787096523.182450:0:27318:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8d25c58f6a00 x1873906345484544/t4294967348(4294967348) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096539 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787096523.182464:0:27318:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787096523.182470:0:27318:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f4e00 x1873906345485184/t0(0) o35->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787096523.182481:0:27318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f4e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345485184:192.168.203.145@tcp:35:lfs.0 00000100:00100000:3.0:1787096523.182508:0:27318:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c51860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096523.183421:0:27318:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f4e00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:27318:1873906345485184:192.168.203.145@tcp:35:lfs.0 00000002:00100000:3.0:1787096523.183437:0:27318:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8d25c58f6a00 x1873906345484544/t4294967348(4294967348) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096539 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000001:02000400:2.0:1787096523.656697:0:27443:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6e: @@@@@@ FAIL: create EC file failed 00010000:00010000:1.0:1787096523.732837:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 295 lines, 295 kept, 0 dropped, 0 bad.