00010000:00010000:1.0F:1787096546.929283:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0F:1787096547.581854:0:27404:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096547.581896:0:27404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096547.581971:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.581981:0:27404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.581989:0:27404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096547.582018:0:27404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489408:192.168.201.140@tcp:101:rm.0 00000100:00100000:0.0:1787096547.582142:0:27404:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c54fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787096547.583650:0:27404:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489408:192.168.201.140@tcp:101:rm.0 00010000:00010000:0.0:1787096547.583671:0:27404:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583681:0:27404:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583693:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583702:0:27404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583709:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583717:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583726:0:27404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096547.583736:0:27404:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c8902d80 x1873906345489408/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096563 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096547.583750:0:27404:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583762:0:27404:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096547.583770:0:27404:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096547.583799:0:27404:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096547.583804:0:27404:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f53 00000080:00010000:0.0:1787096547.583809:0:27404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096547.583812:0:27404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f53 from it ffffae98c1ca7b58 00010000:00010000:0.0:1787096547.583816:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583825:0:27404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096547.583855:0:27404:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096547.583871:0:27404:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:0.0:1787096547.583875:0:27404:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:0.0:1787096547.583894:0:27404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096547.583930:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583947:0:27404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.583958:0:27404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096547.583977:0:27404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489536:192.168.201.140@tcp:101:rm.0 00000100:00100000:0.0:1787096547.584044:0:27404:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c54fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787096547.585605:0:27404:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489536:192.168.201.140@tcp:101:rm.0 00010000:00010000:0.0:1787096547.585622:0:27404:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585637:0:27404:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585643:0:27404:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585655:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585665:0:27404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585673:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585687:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585692:0:27404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096547.585699:0:27404:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c8902d80 x1873906345489536/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096563 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096547.585708:0:27404:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585713:0:27404:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/16 (0 0) 00000080:00200000:0.0:1787096547.585719:0:27404:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096547.585737:0:27404:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x10:0x0], updating i_size 0 00000080:00200000:0.0:1787096547.585739:0:27404:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0x10:0x0](ffff9119e05880c8): rc = 0 00000080:00200000:0.0:1787096547.585781:0:27404:0:(file.c:6803:ll_layout_conf()) [0x200000402:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096547.585802:0:27404:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10:0x0](ffff9119e05880c8) for lock 0xe2ded7f867b1f5a 00000080:00010000:0.0:1787096547.585808:0:27404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10:0x0](ffff9119e05880c8) 00000080:00010000:0.0:1787096547.585812:0:27404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f5a from it ffffae98c1ca7b20 00010000:00010000:0.0:1787096547.585816:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096547.585825:0:27404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787096547.585857:0:27404:0:(file.c:6271:ll_getattr_dentry()) START file f6e.sanity-ec:[0x200000402:0x10:0x0](ffff9119e05880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787096547.585871:0:27404:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x10:0x0](ffff9119e05880c8),name=f6e.sanity-ec 00000002:00010000:0.0:1787096547.585891:0:27404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096547.585901:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096547.585912:0:27404:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096547.585917:0:27404:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096547.585921:0:27404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10:0x0](ffff9119e05880c8) 00000080:00010000:0.0:1787096547.585923:0:27404:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10:0x0](ffff9119e05880c8) for lock 0xe2ded7f867b1f5a 00000080:00010000:0.0:1787096547.585927:0:27404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f5a from it ffffae98c1ca7cb8 00010000:00010000:0.0:1787096547.585930:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096547.585938:0:27404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096547.585991:0:27404:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096547.585999:0:27404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096547.586015:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096547.586027:0:27404:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096547.586034:0:27404:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096547.586038:0:27404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096547.586046:0:27404:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f53 00000080:00010000:0.0:1787096547.586050:0:27404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f53 from it ffffae98c1ca7c10 00010000:00010000:0.0:1787096547.586054:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096547.586061:0:27404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096547.586070:0:27404:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096547.586080:0:27404:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=0 00000080:00200000:0.0:1787096547.586085:0:27404:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096547.586092:0:27404:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096547.586097:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096547.586105:0:27404:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096547.586111:0:27404:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096547.586114:0:27404:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096547.586117:0:27404:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f53 00000080:00010000:0.0:1787096547.586120:0:27404:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f53 from it ffffae98c1ca7d68 00010000:00010000:0.0:1787096547.586122:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096547.586129:0:27404:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096547.586137:0:27404:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:0.0:1787096547.586148:0:27404:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248) 00010000:00010000:0.0:1787096547.586238:0:27404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096547.586264:0:27404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096547.586282:0:27404:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x10:0x0]: losing layout lock 00010000:00010000:0.0:1787096547.586319:0:27404:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 1/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096547.586328:0:27404:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096547.586334:0:27404:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787096547.586337:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460a00/0xe2ded7f867b1f5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166bb56 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096547.586378:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460000/0xe2ded7f867b1f53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166bb3a expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1787096547.586398:0:27404:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787096547.586405:0:27404:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8902d80 x1873906345489792/t0(0) o36->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096547.586429:0:27404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489792:192.168.201.140@tcp:36:rm.0 00000100:00100000:0.0:1787096547.586504:0:27404:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c54fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787096547.588285:0:27404:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:27404:1873906345489792:192.168.201.140@tcp:36:rm.0 00000080:00200000:0.0:1787096547.588400:0:27404:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787096547.588418:0:27404:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787096547.588450:0:27404:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0x10:0x0](ffff9119e05880c8) 00010000:00010000:1.0:1787096547.953250:0:6625:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096548.209909:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c524e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:d421c913-8ded-4ece-9979-167ed163b87c:2403:1873906345489920:192.168.201.140@tcp:400:kworker.0 00000100:00100000:2.0F:1787096548.209923:0:2402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c524d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:70e19547-606a-4706-b016-3476e377d7df:2402:1873906345490048:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096548.210060:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c524c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345490176:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096548.211913:0:2402:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9119c3ff3800: committing for last_committed 4294967352 gen 1 00010000:00080000:2.0:1787096548.211916:0:2403:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9119c524c000 x1873906345490176/t0(0) o400->lustre-MDT0001-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 224/224 e 0 to 0 dl 1787096564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096548.211938:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c524c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345490176:192.168.201.140@tcp:400:kworker.0 00000100:00100000:2.0:1787096548.211964:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c524e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:d421c913-8ded-4ece-9979-167ed163b87c:2403:1873906345489920:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096548.211973:0:2402:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c524d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:70e19547-606a-4706-b016-3476e377d7df:2402:1873906345490048:192.168.201.140@tcp:400:kworker.0 00000001:02000400:0.0:1787096548.310330:0:27558:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 7: nosync flag on parity mirror prevents resync updates ========================================================== 19:42:27 (1787096547) 00000080:00200000:0.0:1787096548.408107:0:27576:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096548.408137:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096548.408214:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.408225:0:27576:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.408234:0:27576:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096548.408258:0:27576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490304:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096548.408345:0:27576:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096548.410504:0:27576:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490304:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096548.410522:0:27576:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410533:0:27576:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410544:0:27576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410554:0:27576:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410580:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410588:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410596:0:27576:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096548.410607:0:27576:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c8902d80 x1873906345490304/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096564 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096548.410620:0:27576:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410630:0:27576:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096548.410636:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096548.410667:0:27576:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096548.410673:0:27576:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f61 00000080:00010000:0.0:1787096548.410677:0:27576:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096548.410681:0:27576:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f61 from it ffffae98c1cafb58 00010000:00010000:0.0:1787096548.410684:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410692:0:27576:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096548.410725:0:27576:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096548.410742:0:27576:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:0.0:1787096548.410746:0:27576:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:0.0:1787096548.410772:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096548.410805:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410812:0:27576:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.410829:0:27576:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096548.410845:0:27576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490432:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096548.410896:0:27576:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096548.413377:0:27576:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490432:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096548.413392:0:27576:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413405:0:27576:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413411:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413417:0:27576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413437:0:27576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413443:0:27576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3460600 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096548.413447:0:27576:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413452:0:27576:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413458:0:27576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413464:0:27576:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096548.413468:0:27576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413473:0:27576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460600/0xe2ded7f867b1f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096548.413487:0:27576:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9119c8902d80 x1873906345490432/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096564 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096548.413498:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787096548.413517:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.413528:0:27576:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787096548.413536:0:27576:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f61 from it ffffae98c1caf930 00010000:00010000:0.0:1787096548.413544:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.413552:0:27576:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096548.413614:0:27576:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096548.413624:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096548.413630:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096548.413638:0:27576:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096548.413644:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096548.413648:0:27576:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096548.413651:0:27576:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f61 00000080:00010000:0.0:1787096548.413655:0:27576:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f61 from it ffffae98c1cafbf8 00010000:00010000:0.0:1787096548.413658:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096548.413665:0:27576:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096548.413673:0:27576:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096548.413681:0:27576:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f7.sanity-ec, flags=777 00000080:00200000:0.0:1787096548.413685:0:27576:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096548.413691:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096548.413696:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096548.413708:0:27576:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096548.413715:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096548.413719:0:27576:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096548.413721:0:27576:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1f61 00000080:00010000:0.0:1787096548.413724:0:27576:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f61 from it ffffae98c1cafb38 00010000:00010000:0.0:1787096548.413727:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096548.413734:0:27576:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787096548.413742:0:27576:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:0.0:1787096548.413747:0:27576:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), file ffff9119e08da780, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787096548.413754:0:27576:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000002:00010000:0.0:1787096548.413770:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x200000402:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787096548.413779:0:27576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096548.413811:0:27576:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096548.413818:0:27576:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096548.413820:0:27576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1f61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166bb80 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096548.413859:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.413865:0:27576:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096548.413874:0:27576:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096548.413880:0:27576:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8902d80 x1873906345490688/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096548.413889:0:27576:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096548.413904:0:27576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490688:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096548.414001:0:27576:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096548.417806:0:27576:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902d80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490688:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096548.417842:0:27576:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417869:0:27576:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/0,1 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417878:0:27576:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/0,1 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417889:0:27576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417921:0:27576:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417933:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417941:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417948:0:27576:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096548.417960:0:27576:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9119c8902d80 x1873906345490688/t4294967353(4294967353) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096564 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787096548.417973:0:27576:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8902d80 x1873906345490688/t4294967353(4294967353) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096564 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096548.417985:0:27576:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.417996:0:27576:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/17 (0 0) 00000080:00200000:0.0:1787096548.418013:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096548.418026:0:27576:0:(namei.c:1619:ll_create_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000080:00200000:0.0:1787096548.418050:0:27576:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0x11:0x0](ffff9119e05880c8) 00000080:00200000:0.0:1787096548.418056:0:27576:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x11:0x0], updating i_size 0 00000080:00200000:0.0:1787096548.418134:0:27576:0:(file.c:6803:ll_layout_conf()) [0x200000402:0x11:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096548.418146:0:27576:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0x11:0x0](ffff9119e05880c8) 00000080:00010000:0.0:1787096548.418155:0:27576:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x11:0x0](ffff9119e05880c8) for lock 0xe2ded7f867b1f6f 00000080:00010000:0.0:1787096548.418166:0:27576:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x11:0x0](ffff9119e05880c8) 00000080:00200008:0.0:1787096548.418204:0:27576:0:(file.c:1058:ll_file_open()) START file f7.sanity-ec:[0x200000402:0x11:0x0](ffff9119e05880c8), flags 120501 00000002:00100000:0.0:1787096548.418227:0:27576:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8902d80 x1873906345490688/t4294967353(4294967353) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096564 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787096548.418263:0:27576:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1f6f from it ffff9119d804e900 00010000:00010000:0.0:1787096548.418268:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.418278:0:27576:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096548.418298:0:27576:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x11:0x0](ffff9119e05880c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787096548.418359:0:27576:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x11:0x0](ffff9119e05880c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787096548.418369:0:27576:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0x11:0x0](ffff9119e05880c8), xattr lov 00000002:00010000:0.0:1787096548.418386:0:27576:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787096548.418428:0:27576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.418434:0:27576:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096548.418443:0:27576:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096548.418449:0:27576:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8902a00 x1873906345490944/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096548.418457:0:27576:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096548.418476:0:27576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490944:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096548.418691:0:27576:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34eecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096548.421087:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.140@tcp (source: 12345-192.168.201.140@tcp) 00000100:00100000:3.0:1787096548.421162:0:6149:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353947008 00000100:00100000:3.0:1787096548.421171:0:6149:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353947008 00000100:00100000:3.0:1787096548.421249:0:6149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.140@tcp, seq: 18 00000100:00100000:3.0:1787096548.421259:0:6149:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9119c524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:70e19547-606a-4706-b016-3476e377d7df+5:6488:x1873906353947008:12345-192.168.201.140@tcp:104: 00010000:00010000:3.0:1787096548.421275:0:6149:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096548.421355:0:6149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096548.421362:0:6149:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9119c524e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:70e19547-606a-4706-b016-3476e377d7df+5:6488:x1873906353947008:12345-192.168.201.140@tcp:104: Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096548.421368:0:6149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.140@tcp, seq: 18 00010000:00010000:0.0:1787096548.421417:0:6157:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096548.421424:0:6157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421433:0:6157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3461400 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096548.421438:0:6157:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421446:0:6157:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421455:0:6157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096548.421500:0:6157:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x11:0x0]: losing layout lock 00010000:00010000:0.0:1787096548.421549:0:6157:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421556:0:6157:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096548.421584:0:6157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 1/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421592:0:6157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461400/0xe2ded7f867b1f6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166bbb1 expref: -99 pid: 27576 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096548.421611:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096548.421615:0:2400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70e19547-606a-4706-b016-3476e377d7df:2400:1873906345491072:192.168.201.140@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096548.421616:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096548.421618:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096548.426115:0:2400:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70e19547-606a-4706-b016-3476e377d7df:2400:1873906345491072:192.168.201.140@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096548.426119:0:27576:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345490944:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096548.426142:0:27576:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426156:0:27576:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426163:0:27576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426170:0:27576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426204:0:27576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426211:0:27576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3461600 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096548.426216:0:27576:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426224:0:27576:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426231:0:27576:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426238:0:27576:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096548.426244:0:27576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096548.426251:0:27576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461600/0xe2ded7f867b1f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27576 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096548.426295:0:27576:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff9119c8902a00 x1873906345490944/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096564 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096548.426309:0:27576:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1787096548.426317:0:27576:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1787096548.426546:0:27576:0:(file.c:448:ll_file_release()) START file f7.sanity-ec:[0x200000402:0x11:0x0](ffff9119e05880c8), flags 100001 00000002:00100000:0.0:1787096548.426596:0:27576:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff9119c8902d80 x1873906345490688/t4294967353(4294967353) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096564 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787096548.426607:0:27576:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787096548.426621:0:27576:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8902a00 x1873906345491328/t0(0) o35->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787096548.426641:0:27576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345491328:192.168.201.140@tcp:35:lfs.0 00000100:00100000:0.0:1787096548.426716:0:27576:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096548.428462:0:27576:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:27576:1873906345491328:192.168.201.140@tcp:35:lfs.0 00000002:00100000:0.0:1787096548.428484:0:27576:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9119c8902d80 x1873906345490688/t4294967353(4294967353) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096564 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787096548.978004:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096549.051440:0:27703:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_7: @@@@@@ FAIL: create EC file failed Debug log: 296 lines, 296 kept, 0 dropped, 0 bad.