00010000:00010000:1.0F:1787096532.593274:0:6157:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0F:1787096532.724869:0:24137:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096532.724899:0:24137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096532.724956:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.724966:0:24137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.724976:0:24137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096532.725001:0:24137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345479936:192.168.201.140@tcp:101:rm.0 00000100:00100000:0.0:1787096532.725273:0:24137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096532.726719:0:24137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345479936:192.168.201.140@tcp:101:rm.0 00010000:00010000:0.0:1787096532.726732:0:24137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726740:0:24137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726750:0:24137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726757:0:24137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726765:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726772:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726788:0:24137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096532.726801:0:24137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c8901f80 x1873906345479936/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096548 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096532.726814:0:24137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726822:0:24137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096532.726828:0:24137:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096532.726862:0:24137:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096532.726869:0:24137:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e81 00000080:00010000:0.0:1787096532.726874:0:24137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096532.726877:0:24137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e81 from it ffffae98c1dcfb58 00010000:00010000:0.0:1787096532.726879:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726886:0:24137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096532.726903:0:24137:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096532.726913:0:24137:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:0.0:1787096532.726916:0:24137:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:0.0:1787096532.726929:0:24137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096532.726949:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726962:0:24137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.726967:0:24137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096532.726978:0:24137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345480064:192.168.201.140@tcp:101:rm.0 00000100:00100000:0.0:1787096532.727015:0:24137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096532.728648:0:24137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345480064:192.168.201.140@tcp:101:rm.0 00010000:00010000:0.0:1787096532.728664:0:24137:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728682:0:24137:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728691:0:24137:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728699:0:24137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728709:0:24137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728719:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728739:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728747:0:24137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096532.728759:0:24137:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c8901f80 x1873906345480064/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096548 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096532.728770:0:24137:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728780:0:24137:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/11 (0 0) 00000080:00200000:0.0:1787096532.728785:0:24137:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096532.728798:0:24137:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xb:0x0], updating i_size 0 00000080:00200000:0.0:1787096532.728800:0:24137:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xb:0x0](ffff9119e0526c08): rc = 0 00000080:00200000:0.0:1787096532.728854:0:24137:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096532.728878:0:24137:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff9119e0526c08) for lock 0xe2ded7f867b1e88 00000080:00010000:0.0:1787096532.728888:0:24137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff9119e0526c08) 00000080:00010000:0.0:1787096532.728891:0:24137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e88 from it ffffae98c1dcfb20 00010000:00010000:0.0:1787096532.728895:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096532.728903:0:24137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787096532.728930:0:24137:0:(file.c:6271:ll_getattr_dentry()) START file f5a.sanity-ec:[0x200000402:0xb:0x0](ffff9119e0526c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787096532.728941:0:24137:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xb:0x0](ffff9119e0526c08),name=f5a.sanity-ec 00000002:00010000:0.0:1787096532.728957:0:24137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xb:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096532.728965:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096532.728975:0:24137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096532.728981:0:24137:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096532.728986:0:24137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff9119e0526c08) 00000080:00010000:0.0:1787096532.728989:0:24137:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff9119e0526c08) for lock 0xe2ded7f867b1e88 00000080:00010000:0.0:1787096532.728993:0:24137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e88 from it ffffae98c1dcfcb8 00010000:00010000:0.0:1787096532.728996:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096532.729003:0:24137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096532.729043:0:24137:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096532.729051:0:24137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096532.729057:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096532.729065:0:24137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096532.729072:0:24137:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096532.729076:0:24137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096532.729084:0:24137:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e81 00000080:00010000:0.0:1787096532.729089:0:24137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e81 from it ffffae98c1dcfc10 00010000:00010000:0.0:1787096532.729092:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096532.729101:0:24137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096532.729110:0:24137:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096532.729117:0:24137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5a.sanity-ec, flags=0 00000080:00200000:0.0:1787096532.729123:0:24137:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096532.729130:0:24137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096532.729137:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096532.729145:0:24137:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096532.729152:0:24137:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096532.729156:0:24137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096532.729158:0:24137:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e81 00000080:00010000:0.0:1787096532.729161:0:24137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e81 from it ffffae98c1dcfd68 00010000:00010000:0.0:1787096532.729163:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096532.729171:0:24137:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096532.729211:0:24137:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:0.0:1787096532.729223:0:24137:0:(namei.c:2404:ll_unlink()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248) 00010000:00010000:0.0:1787096532.729262:0:24137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096532.729284:0:24137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096532.729301:0:24137:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xb:0x0]: losing layout lock 00010000:00010000:0.0:1787096532.729329:0:24137:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096532.729336:0:24137:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096532.729342:0:24137:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787096532.729345:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461800/0xe2ded7f867b1e88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa979d75fc166b854 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096532.729360:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460800/0xe2ded7f867b1e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b838 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1787096532.729383:0:24137:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787096532.729390:0:24137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8901f80 x1873906345480320/t0(0) o36->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096532.729411:0:24137:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345480320:192.168.201.140@tcp:36:rm.0 00000100:00100000:0.0:1787096532.729480:0:24137:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096532.732481:0:24137:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901f80 pname:cluuid:pid:xid:nid:opc:job rm:70e19547-606a-4706-b016-3476e377d7df:24137:1873906345480320:192.168.201.140@tcp:36:rm.0 00000080:00200000:0.0:1787096532.732542:0:24137:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787096532.732554:0:24137:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787096532.732573:0:24137:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xb:0x0](ffff9119e0526c08) 00000100:00100000:1.0:1787096532.851276:0:2400:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096532.851302:0:2400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70e19547-606a-4706-b016-3476e377d7df:2400:1873906345480576:192.168.201.140@tcp:400:kworker.0 00000100:00100000:0.0:1787096532.851302:0:2401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345480704:192.168.201.140@tcp:400:kworker.0 00000100:00100000:1.0:1787096532.851398:0:2400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d421c913-8ded-4ece-9979-167ed163b87c:2400:1873906345480448:192.168.201.140@tcp:400:kworker.0 00000100:00100000:0.0:1787096532.854561:0:2400:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70e19547-606a-4706-b016-3476e377d7df:2400:1873906345480576:192.168.201.140@tcp:400:kworker.0 00000100:00100000:0.0:1787096532.854576:0:2400:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d421c913-8ded-4ece-9979-167ed163b87c:2400:1873906345480448:192.168.201.140@tcp:400:kworker.0 00010000:00080000:0.0:1787096532.854624:0:2401:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9119c8902a00 x1873906345480704/t0(0) o400->lustre-MDT0001-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 224/224 e 0 to 0 dl 1787096548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096532.854632:0:2401:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345480704:192.168.201.140@tcp:400:kworker.0 00000001:02000400:3.0F:1787096533.318481:0:24288:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:42:12 (1787096532) 00000080:00200000:1.0:1787096533.383497:0:24304:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:1.0:1787096533.383522:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096533.383572:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.383579:0:24304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.383599:0:24304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096533.383618:0:24304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c7f11f80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345480832:192.168.201.140@tcp:101:lfs.0 00000100:00100000:1.0:1787096533.383688:0:24304:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119d8b8e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096533.385842:0:24304:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c7f11f80 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345480832:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.385862:0:24304:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385873:0:24304:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385885:0:24304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385903:0:24304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385923:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385944:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385952:0:24304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096533.385967:0:24304:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9119c7f11f80 x1873906345480832/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096549 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096533.385977:0:24304:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.385986:0:24304:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096533.385990:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096533.386105:0:24304:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096533.386112:0:24304:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e8f 00000080:00010000:0.0:1787096533.386117:0:24304:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096533.386121:0:24304:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e8f from it ffffae98c1c9fb58 00010000:00010000:0.0:1787096533.386124:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.386134:0:24304:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096533.386160:0:24304:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096533.386236:0:24304:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), flags=8 00000080:00200000:0.0:1787096533.386242:0:24304:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=getattr 00000002:00010000:0.0:1787096533.386264:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096533.386296:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.386304:0:24304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.386313:0:24304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096533.386330:0:24304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345480960:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096533.386389:0:24304:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096533.387748:0:24304:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345480960:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.387760:0:24304:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387769:0:24304:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387776:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387782:0:24304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387789:0:24304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387795:0:24304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3460c00 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096533.387799:0:24304:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387814:0:24304:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387821:0:24304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387828:0:24304:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096533.387834:0:24304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.387841:0:24304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3460c00/0xe2ded7f867b1e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096533.387854:0:24304:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9119c8902a00 x1873906345480960/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096549 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096533.387865:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787096533.387881:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.387891:0:24304:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787096533.387899:0:24304:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e8f from it ffffae98c1c9f930 00010000:00010000:0.0:1787096533.387902:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.387909:0:24304:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096533.387968:0:24304:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096533.387977:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096533.387984:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096533.387992:0:24304:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096533.387999:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096533.388004:0:24304:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096533.388007:0:24304:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e8f 00000080:00010000:0.0:1787096533.388011:0:24304:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e8f from it ffffae98c1c9fbf8 00010000:00010000:0.0:1787096533.388014:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096533.388021:0:24304:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096533.388029:0:24304:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 1 00000080:00200000:0.0:1787096533.388035:0:24304:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5b.sanity-ec, flags=777 00000080:00200000:0.0:1787096533.388039:0:24304:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248),name=/ 00000002:00010000:0.0:1787096533.388046:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096533.388051:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096533.388059:0:24304:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096533.388077:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096533.388081:0:24304:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) 00000080:00010000:0.0:1787096533.388084:0:24304:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9119e0523248) for lock 0xe2ded7f867b1e8f 00000080:00010000:0.0:1787096533.388088:0:24304:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e8f from it ffffae98c1c9fb38 00010000:00010000:0.0:1787096533.388091:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096533.388099:0:24304:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787096533.388108:0:24304:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9119e0523248), inode mode 41ed mask 3 00000080:00200000:0.0:1787096533.388113:0:24304:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), file ffff9119c9fc0180, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787096533.388121:0:24304:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000002:00010000:0.0:1787096533.388136:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787096533.388147:0:24304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096533.388693:0:24304:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096533.388702:0:24304:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096533.388705:0:24304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119d8193e00/0xe2ded7f867b1e8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa979d75fc166b87e expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096533.388733:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.388750:0:24304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096533.388761:0:24304:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096533.388767:0:24304:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8902a00 x1873906345481216/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096533.388775:0:24304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096533.388790:0:24304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481216:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096533.388873:0:24304:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096533.391206:0:24304:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8902a00 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481216:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.391220:0:24304:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391241:0:24304:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391250:0:24304:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391261:0:24304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391268:0:24304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391290:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391298:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391306:0:24304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096533.391315:0:24304:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9119c8902a00 x1873906345481216/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096549 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787096533.391324:0:24304:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8902a00 x1873906345481216/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096549 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096533.391334:0:24304:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391343:0:24304:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff911a02042800 type 13 mode 4 res 8589935618/12 (0 0) 00000080:00200000:0.0:1787096533.391348:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096533.391356:0:24304:0:(namei.c:1619:ll_create_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff9119e0523248), intent=open|creat 00000080:00200000:0.0:1787096533.391377:0:24304:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0xc:0x0](ffff9119e058ba88) 00000080:00200000:0.0:1787096533.391381:0:24304:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xc:0x0], updating i_size 0 00000080:00200000:0.0:1787096533.391443:0:24304:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096533.391453:0:24304:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0xc:0x0](ffff9119e058ba88) 00000080:00010000:0.0:1787096533.391456:0:24304:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xc:0x0](ffff9119e058ba88) for lock 0xe2ded7f867b1e9d 00000080:00010000:0.0:1787096533.391464:0:24304:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xc:0x0](ffff9119e058ba88) 00000080:00200008:0.0:1787096533.391479:0:24304:0:(file.c:1058:ll_file_open()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff9119e058ba88), flags 120501 00000002:00100000:0.0:1787096533.391491:0:24304:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9119c8902a00 x1873906345481216/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096549 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787096533.391515:0:24304:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe2ded7f867b1e9d from it ffff9119d804e780 00010000:00010000:0.0:1787096533.391518:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391523:0:24304:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096533.391534:0:24304:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff9119e058ba88), inode mode 81a4 mask 40 00000080:00200000:0.0:1787096533.391560:0:24304:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff9119e058ba88), inode mode 81a4 mask 2 00000080:00200000:0.0:1787096533.391568:0:24304:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0xc:0x0](ffff9119e058ba88), xattr lov 00000002:00010000:0.0:1787096533.391595:0:24304:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787096533.391635:0:24304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.391643:0:24304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096533.391651:0:24304:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096533.391656:0:24304:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8901500 x1873906345481472/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 1032/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096533.391668:0:24304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096533.391682:0:24304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481472:192.168.201.140@tcp:101:lfs.0 00000100:00100000:0.0:1787096533.391805:0:24304:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c1cc0 going to sleep for 11 seconds 00000100:00100000:2.0F:1787096533.392843:0:2395:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.140@tcp (source: 12345-192.168.201.140@tcp) 00000100:00100000:2.0:1787096533.392881:0:6150:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787096533.392892:0:6150:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353941120 00000100:00100000:2.0:1787096533.392897:0:6150:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353941120 00000100:00100000:2.0:1787096533.392941:0:6150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.140@tcp, seq: 13 00000100:00100000:2.0:1787096533.392951:0:6150:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9119d9404850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:70e19547-606a-4706-b016-3476e377d7df+5:8109:x1873906353941120:12345-192.168.201.140@tcp:104: 00010000:00010000:2.0:1787096533.392962:0:6150:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096533.393012:0:6150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096533.393018:0:6150:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9119d9404850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:70e19547-606a-4706-b016-3476e377d7df+5:8109:x1873906353941120:12345-192.168.201.140@tcp:104: Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.393035:0:6150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.140@tcp, seq: 13 00010000:00010000:0.0:1787096533.393035:0:6158:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096533.393042:0:6158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393053:0:6158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3461c00 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096533.393059:0:6158:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393067:0:6158:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393076:0:6158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096533.393113:0:6158:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xc:0x0]: losing layout lock 00010000:00010000:0.0:1787096533.393152:0:6158:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393157:0:6158:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096533.393201:0:6158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 1/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393210:0:6158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461c00/0xe2ded7f867b1e9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xa979d75fc166b8af expref: -99 pid: 24304 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096533.393226:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096533.393228:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096533.393231:0:6158:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096533.393240:0:2401:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096533.393252:0:2401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345481600:192.168.201.140@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096533.395276:0:2401:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70e19547-606a-4706-b016-3476e377d7df:2401:1873906345481600:192.168.201.140@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096533.395511:0:24304:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481472:192.168.201.140@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.395524:0:24304:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395535:0:24304:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395543:0:24304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395550:0:24304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395556:0:24304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395562:0:24304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9119c3461a00 already unused, calling callback (ffffffffc1c77b70) 00010000:00010000:0.0:1787096533.395565:0:24304:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395571:0:24304:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395577:0:24304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395595:0:24304:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096533.395600:0:24304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.395617:0:24304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9119c3ff3800 lock: ffff9119c3461a00/0xe2ded7f867b1ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24304 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096533.395636:0:24304:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff9119c8901500 x1873906345481472/t0(0) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 1032/608 e 0 to 0 dl 1787096549 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096533.395649:0:24304:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1787096533.395655:0:24304:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1787096533.395820:0:24304:0:(file.c:448:ll_file_release()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff9119e058ba88), flags 100001 00000002:00100000:0.0:1787096533.395867:0:24304:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff9119c8902a00 x1873906345481216/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096549 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787096533.395878:0:24304:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9119c3ff3800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787096533.395888:0:24304:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9119c8901500 x1873906345481856/t0(0) o35->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787096533.395905:0:24304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481856:192.168.201.140@tcp:35:lfs.0 00000100:00100000:0.0:1787096533.395947:0:24304:0:(client.c:2692:ptlrpc_set_wait()) set ffff9119e09c1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096533.397390:0:24304:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9119c8901500 pname:cluuid:pid:xid:nid:opc:job lfs:70e19547-606a-4706-b016-3476e377d7df:24304:1873906345481856:192.168.201.140@tcp:35:lfs.0 00000002:00100000:1.0:1787096533.397412:0:24304:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9119c8902a00 x1873906345481216/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff9119c3ff3800@192.168.201.140@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096549 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787096533.617255:0:6625:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096533.883843:0:24433:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed Debug log: 297 lines, 297 kept, 0 dropped, 0 bad.