00010000:00010000:3.0F:1787096458.865670:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0F:1787096459.437309:0:12978:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:2.0:1787096459.437343:0:12978:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096459.437403:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096459.437415:0:12978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096459.437425:0:12978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096459.437451:0:12978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c524f480 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465344:192.168.201.140@tcp:101:rm.0 00000100:00100000:2.0:1787096459.437536:0:12978:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c54d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787096459.439430:0:12978:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c524f480 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465344:192.168.201.140@tcp:101:rm.0 00010000:00010000:3.0:1787096459.439469:0:12978:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439483:0:12978:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439495:0:12978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439507:0:12978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439519:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439527:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439535:0:12978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096459.439546:0:12978:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c524f480 x1873906345465344/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096475 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096459.439560:0:12978:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439572:0:12978:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1787096459.439587:0:12978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787096459.439613:0:12978:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1787096459.439619:0:12978:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d8c 00000080:00010000:3.0:1787096459.439625:0:12978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:3.0:1787096459.439628:0:12978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d8c from it ffffae98c198fb58 00010000:00010000:3.0:1787096459.439632:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439641:0:12978:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096459.439665:0:12978:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:3.0:1787096459.439686:0:12978:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f1d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:3.0:1787096459.439691:0:12978:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:3.0:1787096459.439711:0:12978:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096459.439743:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439751:0:12978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.439760:0:12978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096459.439778:0:12978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50de680 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465472:192.168.201.140@tcp:101:rm.0 00000100:00100000:3.0:1787096459.439921:0:12978:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e0350d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096459.445877:0:12978:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50de680 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465472:192.168.201.140@tcp:101:rm.0 00010000:00010000:3.0:1787096459.445903:0:12978:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445931:0:12978:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445940:0:12978:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445952:0:12978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445963:0:12978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445976:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445984:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.445992:0:12978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096459.446004:0:12978:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c50de680 x1873906345465472/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096475 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096459.446017:0:12978:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.446027:0:12978:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/6 (0 0) 00000080:00200000:3.0:1787096459.446039:0:12978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096459.446058:0:12978:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x6:0x0], updating i_size 0 00000080:00200000:3.0:1787096459.446061:0:12978:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0x6:0x0](ffff9119e058f448): rc = 0 00000080:00200000:3.0:1787096459.446114:0:12978:0:(file.c:6803:ll_layout_conf()) [0x200000402:0x6:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096459.446134:0:12978:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x6:0x0](ffff9119e058f448) for lock 0xe2ded7f867b1d93 00000080:00010000:3.0:1787096459.446143:0:12978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x6:0x0](ffff9119e058f448) 00000080:00010000:3.0:1787096459.446147:0:12978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d93 from it ffffae98c198fb20 00010000:00010000:3.0:1787096459.446151:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096459.446161:0:12978:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787096459.447520:0:12978:0:(file.c:6271:ll_getattr_dentry()) START file f1d.sanity-ec:[0x200000402:0x6:0x0](ffff9119e058f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787096459.447529:0:12978:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x6:0x0](ffff9119e058f448),name=f1d.sanity-ec 00000002:00010000:3.0:1787096459.447550:0:12978:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x6:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096459.447561:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096459.447574:0:12978:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096459.447581:0:12978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096459.447586:0:12978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x6:0x0](ffff9119e058f448) 00000080:00010000:3.0:1787096459.447589:0:12978:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x6:0x0](ffff9119e058f448) for lock 0xe2ded7f867b1d93 00000080:00010000:3.0:1787096459.447593:0:12978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d93 from it ffffae98c198fcb8 00010000:00010000:3.0:1787096459.447596:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096459.447615:0:12978:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096459.447662:0:12978:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:3.0:1787096459.447682:0:12978:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096459.447690:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096459.447698:0:12978:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096459.447704:0:12978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096459.447709:0:12978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:3.0:1787096459.447711:0:12978:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d8c 00000080:00010000:3.0:1787096459.447715:0:12978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d8c from it ffffae98c198fc10 00010000:00010000:3.0:1787096459.447718:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096459.447725:0:12978:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096459.447743:0:12978:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:3.0:1787096459.447751:0:12978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1d.sanity-ec, flags=0 00000080:00200000:3.0:1787096459.447756:0:12978:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:3.0:1787096459.447763:0:12978:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096459.447769:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096459.447783:0:12978:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096459.447789:0:12978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096459.447793:0:12978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:3.0:1787096459.447796:0:12978:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d8c 00000080:00010000:3.0:1787096459.447800:0:12978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d8c from it ffffae98c198fd68 00010000:00010000:3.0:1787096459.447803:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096459.447810:0:12978:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096459.447818:0:12978:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:3.0:1787096459.448492:0:12978:0:(namei.c:2404:ll_unlink()) VFS Op:name=f1d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248) 00010000:00010000:2.0:1787096459.451961:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096459.452002:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096459.452024:0:12978:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x6:0x0]: losing layout lock 00010000:00010000:2.0:1787096459.452072:0:12978:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096459.452080:0:12978:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096459.452087:0:12978:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787096459.452089:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166b4e9 expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096459.452115:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff911a021fe000/0xe2ded7f867b1d8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b4cd expref: -99 pid: 12978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1787096459.452142:0:12978:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096459.452154:0:12978:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c524f100 x1873906345465728/t0(0) o36->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096459.452267:0:12978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c524f100 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465728:192.168.201.140@tcp:36:rm.0 00000100:00100000:2.0:1787096459.452364:0:12978:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c54d0cc0 going to sleep for 11 seconds 00000100:00100000:1.0F:1787096459.459789:0:12978:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c524f100 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:12978:1873906345465728:192.168.201.140@tcp:36:rm.0 00000080:00200000:1.0:1787096459.459900:0:12978:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0x6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787096459.459911:0:12978:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787096459.459938:0:12978:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0x6:0x0](ffff9119e058f448) 00010000:00010000:0.0F:1787096459.890450:0:6625:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096460.448537:0:13132:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1e: setstripe with EC inheriting to second component ========================================================== 19:40:59 (1787096459) 00010000:00010000:2.0:1787096460.913455:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096461.172430:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345465984:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096461.172512:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345466240:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096461.172541:0:2403:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787096461.172547:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:d421c913-8ded-4ece-9979-167ed163b87c:2403:1873906345465856:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096461.172569:0:2403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345466112:192.168.201.140@tcp:400:kworker.0 00000100:00100000:2.0:1787096461.174533:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:d421c913-8ded-4ece-9979-167ed163b87c:2403:1873906345465856:192.168.201.140@tcp:400:kworker.0 00000100:00100000:2.0:1787096461.174549:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345466240:192.168.201.140@tcp:400:kworker.0 00010000:00080000:3.0:1787096461.174940:0:2403:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9119c50ded80 x1873906345466112/t0(0) o400->lustre-MDT0001-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 224/224 e 0 to 0 dl 1787096477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096461.175003:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345466112:192.168.201.140@tcp:400:kworker.0 00000100:00100000:3.0:1787096461.175017:0:2403:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:70e19547-606a-4706-b016-3476e377d7df:2403:1873906345465984:192.168.201.140@tcp:400:kworker.0 00000001:02000400:2.0:1787096461.342163:0:13270:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1e needs >= 6 OSTs 00010000:00010000:3.0:1787096461.937484:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096462.320537:0:13424:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1f: setstripe with different EC for different components ========================================================== 19:41:01 (1787096461) 00010000:00010000:0.0:1787096462.961353:0:6625:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096463.148940:0:13562:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1f needs >= 6 OSTs 00010000:00010000:3.0:1787096463.985295:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096464.063999:0:13716:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1g: setstripe with different parity counts ========================================================== 19:41:03 (1787096463) 00000080:00200000:3.0:1787096464.249124:0:13734:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:3.0:1787096464.249153:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096464.249241:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096464.249254:0:13734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096464.249264:0:13734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096464.249291:0:13734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c50dc700 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466368:192.168.201.140@tcp:101:lfs.0 00000100:00100000:3.0:1787096464.249449:0:13734:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119c34c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096464.251866:0:13734:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9119c3ff3800: committing for last_committed 4294967322 gen 1 00000100:00100000:0.0:1787096464.251917:0:13734:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c50dc700 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466368:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096464.251943:0:13734:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.251958:0:13734:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.251973:0:13734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.251985:0:13734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.251999:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252009:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252017:0:13734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096464.252031:0:13734:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c50dc700 x1873906345466368/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096480 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096464.252062:0:13734:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252078:0:13734:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096464.252086:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096464.252120:0:13734:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096464.252126:0:13734:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d9a 00000080:00010000:0.0:1787096464.252133:0:13734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096464.252136:0:13734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d9a from it ffffae98c1cb7b58 00010000:00010000:0.0:1787096464.252140:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252149:0:13734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096464.252214:0:13734:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096464.252238:0:13734:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f1g.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:0.0:1787096464.252243:0:13734:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1g.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:0.0:1787096464.252271:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1g.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096464.252318:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252326:0:13734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.252336:0:13734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096464.252368:0:13734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903100 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466496:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096464.252466:0:13734:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119d073e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787096464.254004:0:13734:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903100 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466496:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096464.254020:0:13734:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254033:0:13734:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254040:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254047:0:13734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254055:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254061:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c0031c00 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096464.254066:0:13734:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254072:0:13734:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254079:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254087:0:13734:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096464.254105:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254112:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0031c00/0xe2ded7f867b1da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096464.254131:0:13734:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9119c8903100 x1873906345466496/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096480 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096464.254144:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787096464.254167:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.254222:0:13734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787096464.254232:0:13734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d9a from it ffffae98c1cb7930 00010000:00010000:0.0:1787096464.254236:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.254244:0:13734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096464.254331:0:13734:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096464.254342:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096464.254349:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096464.254358:0:13734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096464.254379:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096464.254384:0:13734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096464.254388:0:13734:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d9a 00000080:00010000:0.0:1787096464.254392:0:13734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d9a from it ffffae98c1cb7bf8 00010000:00010000:0.0:1787096464.254395:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096464.254404:0:13734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096464.254413:0:13734:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096464.254424:0:13734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1g.sanity-ec, flags=777 00000080:00200000:0.0:1787096464.254429:0:13734:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096464.254437:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096464.254443:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096464.254451:0:13734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096464.254458:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096464.254462:0:13734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096464.254464:0:13734:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1d9a 00000080:00010000:0.0:1787096464.254468:0:13734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1d9a from it ffffae98c1cb7b38 00010000:00010000:0.0:1787096464.254471:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096464.254489:0:13734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787096464.254497:0:13734:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:0.0:1787096464.254503:0:13734:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f1g.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), file ffff9119d11e3680, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787096464.254511:0:13734:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1g.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000002:00010000:0.0:1787096464.254529:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1g.sanity-ec,[0x200000402:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787096464.254540:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096464.254581:0:13734:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096464.254589:0:13734:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096464.254592:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c1489c00/0xe2ded7f867b1d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b513 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096464.254625:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.254633:0:13734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096464.254644:0:13734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096464.254650:0:13734:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8903100 x1873906345466752/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096464.254659:0:13734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096464.254681:0:13734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903100 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466752:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096464.254894:0:13734:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119d073e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787096464.256665:0:13734:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903100 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345466752:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096464.256688:0:13734:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256719:0:13734:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/0,1 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256804:0:13734:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/0,1 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256818:0:13734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256832:0:13734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256845:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256854:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256862:0:13734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096464.256892:0:13734:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9119c8903100 x1873906345466752/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096480 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787096464.256906:0:13734:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8903100 x1873906345466752/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096480 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096464.256920:0:13734:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.256931:0:13734:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/7 (0 0) 00000080:00200000:0.0:1787096464.256938:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096464.256950:0:13734:0:(namei.c:1619:ll_create_it()) VFS Op:name=f1g.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000080:00200000:0.0:1787096464.256980:0:13734:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9119e058db88) 00000080:00200000:0.0:1787096464.256988:0:13734:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x7:0x0], updating i_size 0 00000080:00200000:0.0:1787096464.257091:0:13734:0:(file.c:6803:ll_layout_conf()) [0x200000402:0x7:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096464.257102:0:13734:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0x7:0x0](ffff9119e058db88) 00000080:00010000:0.0:1787096464.257106:0:13734:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7:0x0](ffff9119e058db88) for lock 0xe2ded7f867b1da8 00000080:00010000:0.0:1787096464.257116:0:13734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7:0x0](ffff9119e058db88) 00000080:00200008:0.0:1787096464.257130:0:13734:0:(file.c:1058:ll_file_open()) START file f1g.sanity-ec:[0x200000402:0x7:0x0](ffff9119e058db88), flags 120501 00000002:00100000:0.0:1787096464.257151:0:13734:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8903100 x1873906345466752/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096480 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787096464.257236:0:13734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1da8 from it ffff9119d804e9c0 00010000:00010000:0.0:1787096464.257241:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.257253:0:13734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096464.257288:0:13734:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9119e058db88), inode mode 81a4 mask 40 00000080:00200000:0.0:1787096464.257351:0:13734:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9119e058db88), inode mode 81a4 mask 2 00000080:00200000:0.0:1787096464.257364:0:13734:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0x7:0x0](ffff9119e058db88), xattr lov 00000002:00010000:0.0:1787096464.257382:0:13734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787096464.257428:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.257436:0:13734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096464.257446:0:13734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096464.257452:0:13734:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8903b80 x1873906345467008/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 872/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096464.257461:0:13734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096464.257481:0:13734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903b80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345467008:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096464.257683:0:13734:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119d073e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787096464.258945:0:2394:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.140@tcp (source: 12345-192.168.201.140@tcp) 00000100:00100000:2.0:1787096464.259219:0:6149:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353908736 00000100:00100000:2.0:1787096464.259230:0:6149:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353908736 00000100:00100000:2.0:1787096464.259830:0:6149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.140@tcp, seq: 8 00000100:00100000:2.0:1787096464.259843:0:6149:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9119c50ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:70e19547-606a-4706-b016-3476e377d7df+5:6490:x1873906353908736:12345-192.168.201.140@tcp:104: 00010000:00010000:2.0:1787096464.259861:0:6149:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096464.259937:0:6149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096464.259944:0:6149:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9119c50ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:70e19547-606a-4706-b016-3476e377d7df+5:6490:x1873906353908736:12345-192.168.201.140@tcp:104: Request processed in 105us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096464.259951:0:6149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.140@tcp, seq: 8 00010000:00010000:0.0:1787096464.259977:0:6158:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096464.259988:0:6158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260000:0:6158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c0030000 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096464.260005:0:6158:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260014:0:6158:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260038:0:6158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096464.260094:0:6158:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x7:0x0]: losing layout lock 00010000:00010000:0.0:1787096464.260157:0:6158:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260165:0:6158:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096464.260228:0:6158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260238:0:6158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030000/0xe2ded7f867b1da8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b544 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096464.260266:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096464.260268:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096464.260271:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096464.260273:0:2401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345467136:192.168.201.140@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787096464.262637:0:2401:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345467136:192.168.201.140@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096464.262637:0:13734:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903b80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345467008:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096464.262666:0:13734:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262683:0:13734:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262692:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262701:0:13734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262737:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262810:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c0030c00 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096464.262815:0:13734:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262822:0:13734:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262830:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262838:0:13734:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096464.262844:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096464.262850:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c0030c00/0xe2ded7f867b1daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 13734 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096464.262882:0:13734:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff9119c8903b80 x1873906345467008/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 872/608 e 0 to 0 dl 1787096480 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096464.262898:0:13734:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1787096464.262906:0:13734:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1787096464.263137:0:13734:0:(file.c:448:ll_file_release()) START file f1g.sanity-ec:[0x200000402:0x7:0x0](ffff9119e058db88), flags 100001 00000002:00100000:0.0:1787096464.263236:0:13734:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff9119c8903100 x1873906345466752/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096480 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787096464.263249:0:13734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787096464.263255:0:13734:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8903b80 x1873906345467392/t0(0) o35->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787096464.263287:0:13734:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903b80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345467392:192.168.201.140@tcp:35:lfs.0 00000100:00100000:0.0:1787096464.263462:0:13734:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119d073e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787096464.264826:0:13734:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903b80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:13734:1873906345467392:192.168.201.140@tcp:35:lfs.0 00000002:00100000:0.0:1787096464.264855:0:13734:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9119c8903100 x1873906345466752/t4294967323(4294967323) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096480 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787096465.011588:0:6625:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096465.041124:0:13861:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_1g: @@@@@@ FAIL: setstripe failed Debug log: 307 lines, 307 kept, 0 dropped, 0 bad.