00010000:00010000:1.0F:1782107082.814762:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1782107083.772723:0:25367:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:1.0:1782107083.772750:0:25367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1782107083.772831:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107083.772843:0:25367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107083.772853:0:25367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107083.772879:0:25367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51376680 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246953856:192.168.203.143@tcp:101:rm.0 00000100:00100000:1.0:1782107083.772975:0:25367:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51aa5f00 going to sleep for 11 seconds 00000100:00100000:2.0F:1782107083.775676:0:25367:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff935d47879800: committing for last_committed 4294967342 gen 1 00000100:00100000:2.0:1782107083.775715:0:25367:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51376680 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246953856:192.168.203.143@tcp:101:rm.0 00010000:00010000:2.0:1782107083.775734:0:25367:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775747:0:25367:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775760:0:25367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775771:0:25367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775784:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775792:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775800:0:25367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107083.775934:0:25367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d51376680 x1868674246953856/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107099 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107083.775949:0:25367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.775960:0:25367:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1782107083.775973:0:25367:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1782107083.776254:0:25367:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1782107083.776262:0:25367:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3ccc 00000080:00010000:2.0:1782107083.776267:0:25367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:2.0:1782107083.776270:0:25367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3ccc from it ffffb79701653b58 00010000:00010000:2.0:1782107083.776273:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.776282:0:25367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107083.776302:0:25367:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:2.0:1782107083.776319:0:25367:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:2.0:1782107083.776324:0:25367:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:2.0:1782107083.776342:0:25367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107083.776395:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.776401:0:25367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107083.776409:0:25367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107083.776428:0:25367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2ea00 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246953984:192.168.203.143@tcp:101:rm.0 00000100:00100000:2.0:1782107083.776552:0:25367:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d48471540 going to sleep for 11 seconds 00000100:00100000:0.0F:1782107083.781383:0:25367:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2ea00 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246953984:192.168.203.143@tcp:101:rm.0 00010000:00010000:0.0:1782107083.781421:0:25367:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781442:0:25367:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781450:0:25367:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781462:0:25367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781472:0:25367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781484:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781492:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781499:0:25367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782107083.781510:0:25367:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d51a2ea00 x1868674246953984/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107099 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782107083.781521:0:25367:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781541:0:25367:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/13 (0 0) 00000080:00200000:0.0:1782107083.781548:0:25367:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782107083.781566:0:25367:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xd:0x0], updating i_size 0 00000080:00200000:0.0:1782107083.781569:0:25367:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xd:0x0](ffff935d48d7cb08): rc = 0 00000080:00200000:0.0:1782107083.781607:0:25367:0:(file.c:6821:ll_layout_conf()) [0x200000402:0xd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1782107083.781628:0:25367:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xd:0x0](ffff935d48d7cb08) for lock 0x518b9a3576b3cd3 00000080:00010000:0.0:1782107083.781637:0:25367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xd:0x0](ffff935d48d7cb08) 00000080:00010000:0.0:1782107083.781640:0:25367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cd3 from it ffffb79701653b20 00010000:00010000:0.0:1782107083.781643:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107083.781651:0:25367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1782107083.781684:0:25367:0:(file.c:6289:ll_getattr_dentry()) START file f6a.sanity-ec:[0x200000402:0xd:0x0](ffff935d48d7cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1782107083.781689:0:25367:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xd:0x0](ffff935d48d7cb08),name=f6a.sanity-ec 00000002:00010000:0.0:1782107083.781704:0:25367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107083.781711:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107083.781718:0:25367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107083.781722:0:25367:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107083.781726:0:25367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xd:0x0](ffff935d48d7cb08) 00000080:00010000:0.0:1782107083.781728:0:25367:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xd:0x0](ffff935d48d7cb08) for lock 0x518b9a3576b3cd3 00000080:00010000:0.0:1782107083.781737:0:25367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cd3 from it ffffb79701653cb8 00010000:00010000:0.0:1782107083.781741:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107083.781747:0:25367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107083.781794:0:25367:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107083.781801:0:25367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107083.781828:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107083.781836:0:25367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107083.781841:0:25367:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107083.781858:0:25367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:0.0:1782107083.781860:0:25367:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3ccc 00000080:00010000:0.0:1782107083.781863:0:25367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3ccc from it ffffb79701653c10 00010000:00010000:0.0:1782107083.781865:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107083.781873:0:25367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107083.781890:0:25367:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:0.0:1782107083.781899:0:25367:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6a.sanity-ec, flags=0 00000080:00200000:0.0:1782107083.781902:0:25367:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107083.781914:0:25367:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107083.781921:0:25367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107083.781928:0:25367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107083.781933:0:25367:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107083.781937:0:25367:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:0.0:1782107083.781939:0:25367:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3ccc 00000080:00010000:0.0:1782107083.781941:0:25367:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3ccc from it ffffb79701653d68 00010000:00010000:0.0:1782107083.781944:0:25367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107083.781950:0:25367:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1782107083.781957:0:25367:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:0.0:1782107083.781962:0:25367:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08) 00010000:00010000:0.0:1782107083.781994:0:25367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782107083.782014:0:25367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107083.782030:0:25367:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xd:0x0]: losing layout lock 00010000:00010000:0.0:1782107083.782077:0:25367:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107083.782095:0:25367:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782107083.782100:0:25367:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1782107083.782103:0:25367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518400/0x518b9a3576b3cd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a12904 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107083.782118:0:25367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4a00/0x518b9a3576b3ccc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a128e8 expref: -99 pid: 25367 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1782107083.782138:0:25367:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782107083.782145:0:25367:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d44380700 x1868674246954240/t0(0) o36->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107083.782180:0:25367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44380700 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246954240:192.168.203.143@tcp:36:rm.0 00000100:00100000:0.0:1782107083.782260:0:25367:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d485e1a80 going to sleep for 11 seconds 00000100:00100000:3.0F:1782107083.791062:0:25367:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44380700 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25367:1868674246954240:192.168.203.143@tcp:36:rm.0 00000080:00200000:3.0:1782107083.791143:0:25367:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1782107083.791151:0:25367:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782107083.791189:0:25367:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xd:0x0](ffff935d48d7cb08) 00010000:00010000:3.0:1782107083.836907:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107084.864512:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107085.347531:0:25514:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 01:44:44 (1782107084) 00000080:00200000:0.0:1782107085.711159:0:25532:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107085.711190:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107085.711252:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107085.711262:0:25532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107085.711271:0:25532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107085.711294:0:25532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44383100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954368:192.168.203.143@tcp:101:lfs.0 00000100:00100000:0.0:1782107085.711465:0:25532:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d485e1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782107085.725022:0:25532:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44383100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954368:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107085.725047:0:25532:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725060:0:25532:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725071:0:25532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725081:0:25532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725093:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725100:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725107:0:25532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107085.725160:0:25532:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d44383100 x1868674246954368/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107101 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107085.725177:0:25532:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725193:0:25532:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1782107085.725199:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782107085.725229:0:25532:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1782107085.725234:0:25532:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3cda 00000080:00010000:3.0:1782107085.725240:0:25532:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107085.725242:0:25532:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cda from it ffffb79701c0bb58 00010000:00010000:3.0:1782107085.725245:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725253:0:25532:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107085.725278:0:25532:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107085.725298:0:25532:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:3.0:1782107085.725303:0:25532:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:3.0:1782107085.725321:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107085.725359:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725367:0:25532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.725387:0:25532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107085.725406:0:25532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954496:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107085.725485:0:25532:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51ba1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107085.729352:0:25532:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954496:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107085.729372:0:25532:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729385:0:25532:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729392:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729399:0:25532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729407:0:25532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729412:0:25532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cce00 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107085.729416:0:25532:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729422:0:25532:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729428:0:25532:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729450:0:25532:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107085.729456:0:25532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.729462:0:25532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107085.729480:0:25532:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff935d443df100 x1868674246954496/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107101 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107085.729493:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1782107085.729520:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.729532:0:25532:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1782107085.729540:0:25532:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cda from it ffffb79701c0b930 00010000:00010000:3.0:1782107085.729543:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.729551:0:25532:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107085.730035:0:25532:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107085.730053:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107085.730061:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107085.730082:0:25532:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107085.730089:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107085.730096:0:25532:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107085.730099:0:25532:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3cda 00000080:00010000:3.0:1782107085.730105:0:25532:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cda from it ffffb79701c0bbf8 00010000:00010000:3.0:1782107085.730252:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107085.730262:0:25532:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107085.730273:0:25532:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107085.730282:0:25532:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6b.sanity-ec, flags=777 00000080:00200000:3.0:1782107085.730287:0:25532:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107085.730295:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107085.730302:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107085.730311:0:25532:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107085.730317:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107085.730322:0:25532:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107085.730324:0:25532:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3cda 00000080:00010000:3.0:1782107085.730328:0:25532:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3cda from it ffffb79701c0bb38 00010000:00010000:3.0:1782107085.730338:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107085.730346:0:25532:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1782107085.730355:0:25532:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:3.0:1782107085.730360:0:25532:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), file ffff935d4431bc80, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1782107085.730369:0:25532:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000002:00010000:3.0:1782107085.730387:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x200000402:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1782107085.730397:0:25532:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107085.730437:0:25532:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107085.730444:0:25532:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107085.730447:0:25532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a400/0x518b9a3576b3cda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a1292e expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107085.730477:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107085.730483:0:25532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107085.730492:0:25532:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107085.730499:0:25532:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443df100 x1868674246954752/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107085.730519:0:25532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107085.730537:0:25532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954752:192.168.203.143@tcp:101:lfs.0 00000100:00100000:2.0:1782107085.733347:0:25532:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51ba1900 going to sleep for 11 seconds 00000100:00100000:2.0:1782107085.745093:0:25532:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246954752:192.168.203.143@tcp:101:lfs.0 00010000:00010000:2.0:1782107085.745126:0:25532:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745164:0:25532:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745172:0:25532:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745183:0:25532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745193:0:25532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745204:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745211:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745218:0:25532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107085.745229:0:25532:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff935d443df100 x1868674246954752/t4294967344(4294967344) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107101 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1782107085.745241:0:25532:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443df100 x1868674246954752/t4294967344(4294967344) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107101 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107085.745268:0:25532:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745278:0:25532:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/14 (0 0) 00000080:00200000:2.0:1782107085.745284:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1782107085.745295:0:25532:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000080:00200000:2.0:1782107085.745318:0:25532:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0xe:0x0](ffff935d48d19988) 00000080:00200000:2.0:1782107085.745325:0:25532:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xe:0x0], updating i_size 0 00000080:00200000:2.0:1782107085.745401:0:25532:0:(file.c:6821:ll_layout_conf()) [0x200000402:0xe:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1782107085.745411:0:25532:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0xe:0x0](ffff935d48d19988) 00000080:00010000:2.0:1782107085.745414:0:25532:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xe:0x0](ffff935d48d19988) for lock 0x518b9a3576b3ce8 00000080:00010000:2.0:1782107085.745422:0:25532:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xe:0x0](ffff935d48d19988) 00000080:00200008:2.0:1782107085.745435:0:25532:0:(file.c:1058:ll_file_open()) START file f6b.sanity-ec:[0x200000402:0xe:0x0](ffff935d48d19988), flags 120501 00000002:00100000:2.0:1782107085.745454:0:25532:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443df100 x1868674246954752/t4294967344(4294967344) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107101 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1782107085.745488:0:25532:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3ce8 from it ffff935d4384b3c0 00010000:00010000:2.0:1782107085.745493:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.745502:0:25532:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107085.745521:0:25532:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0xe:0x0](ffff935d48d19988), inode mode 81a4 mask 40 00000080:00200000:2.0:1782107085.745563:0:25532:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0xe:0x0](ffff935d48d19988), inode mode 81a4 mask 2 00000080:00200000:2.0:1782107085.745572:0:25532:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0xe:0x0](ffff935d48d19988), xattr lov 00000002:00010000:2.0:1782107085.745587:0:25532:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1782107085.749291:0:25532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.749308:0:25532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1782107085.749320:0:25532:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1782107085.749332:0:25532:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d51a2c380 x1868674246955008/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1782107085.749341:0:25532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107085.749364:0:25532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2c380 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246955008:192.168.203.143@tcp:101:lfs.0 00000100:00100000:2.0:1782107085.749532:0:25532:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d48471480 going to sleep for 11 seconds 00000100:00100000:0.0:1782107085.752979:0:2403:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.143@tcp (source: 12345-192.168.203.143@tcp) 00000100:00100000:1.0:1782107085.753093:0:6172:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269107712 00000100:00100000:1.0:1782107085.753103:0:6172:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269107712 00000100:00100000:1.0:1782107085.753162:0:6172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.143@tcp, seq: 15 00000100:00100000:1.0:1782107085.753172:0:6172:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff935d44383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:8982:x1868674269107712:12345-192.168.203.143@tcp:104: 00010000:00010000:1.0:1782107085.753190:0:6172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107085.753258:0:6172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107085.753264:0:6172:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff935d44383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:8982:x1868674269107712:12345-192.168.203.143@tcp:104: Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107085.753271:0:6172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.143@tcp, seq: 15 00010000:00010000:3.0:1782107085.753531:0:6181:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107085.753538:0:6181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753546:0:6181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cc200 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107085.753551:0:6181:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753560:0:6181:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753567:0:6181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107085.753616:0:6181:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xe:0x0]: losing layout lock 00010000:00010000:3.0:1782107085.753663:0:6181:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753670:0:6181:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107085.753701:0:6181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753709:0:6181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc200/0x518b9a3576b3ce8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1295f expref: -99 pid: 25532 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107085.753744:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107085.753745:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107085.753747:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107085.753755:0:2413:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107085.753769:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955136:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782107085.756972:0:25532:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2c380 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246955008:192.168.203.143@tcp:101:lfs.0 00010000:00010000:2.0:1782107085.756990:0:25532:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757003:0:25532:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757010:0:25532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757018:0:25532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757027:0:25532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757049:0:25532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d48518c00 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:2.0:1782107085.757053:0:25532:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757059:0:25532:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757076:0:25532:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757082:0:25532:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1782107085.757088:0:25532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107085.757095:0:25532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d48518c00/0x518b9a3576b3cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 25532 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107085.757119:0:25532:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff935d51a2c380 x1868674246955008/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 712/608 e 0 to 0 dl 1782107101 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1782107085.757132:0:25532:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:2.0:1782107085.757139:0:25532:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:2.0:1782107085.757320:0:25532:0:(file.c:448:ll_file_release()) START file f6b.sanity-ec:[0x200000402:0xe:0x0](ffff935d48d19988), flags 100001 00000002:00100000:2.0:1782107085.757366:0:25532:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff935d443df100 x1868674246954752/t4294967344(4294967344) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107101 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1782107085.757376:0:25532:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1782107085.757381:0:25532:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d51a2c380 x1868674246955392/t0(0) o35->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1782107085.757401:0:25532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2c380 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246955392:192.168.203.143@tcp:35:lfs.0 00000100:00100000:2.0:1782107085.757532:0:25532:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d48471900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107085.759293:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955136:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782107085.767464:0:25532:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2c380 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:25532:1868674246955392:192.168.203.143@tcp:35:lfs.0 00000002:00100000:2.0:1782107085.767499:0:25532:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff935d443df100 x1868674246954752/t4294967344(4294967344) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107101 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1782107085.887237:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107086.909047:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107086.973684:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2413:1868674246955520:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107086.973785:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955776:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107086.973846:0:2413:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107086.973852:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955648:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107086.978044:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955648:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107086.978059:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2413:1868674246955520:192.168.203.143@tcp:400:kworker.0 00010000:00080000:2.0:1782107086.978650:0:2413:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff935d443df800 x1868674246955776/t0(0) o400->lustre-MDT0001-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 224/224 e 0 to 0 dl 1782107102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107086.978665:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246955776:192.168.203.143@tcp:400:kworker.0 00000001:02000400:2.0:1782107087.140195:0:25659:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6b: @@@@@@ FAIL: create EC file failed 00010000:00010000:1.0:1782107087.935943:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 301 lines, 301 kept, 0 dropped, 0 bad.