00010000:00010000:2.0F:1787096248.210221:0:5567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1787096248.338301:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:798d21dd-514b-4f09-968a-bf40d03220f0:2361:1873906083336320:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1787096248.338403:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096248.338415:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:2361:1873906083336448:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1787096248.339478:0:2361:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:798d21dd-514b-4f09-968a-bf40d03220f0:2361:1873906083336320:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1787096248.339592:0:2361:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff96268a49c800: committing for last_committed 4294967343 gen 1 00000100:00100000:1.0:1787096248.339616:0:2361:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:2361:1873906083336448:192.168.204.135@tcp:400:kworker.0 00000080:00200000:0.0F:1787096248.735483:0:26009:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:0.0:1787096248.735506:0:26009:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096248.735561:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.735573:0:26009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.735584:0:26009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096248.735613:0:26009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336576:192.168.204.135@tcp:101:rm.0 00000100:00100000:0.0:1787096248.735703:0:26009:0:(client.c:2692:ptlrpc_set_wait()) set ffff962691a1ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096248.737348:0:26009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336576:192.168.204.135@tcp:101:rm.0 00010000:00010000:0.0:1787096248.737361:0:26009:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737369:0:26009:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737378:0:26009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737385:0:26009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737392:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737398:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737412:0:26009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096248.737421:0:26009:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff962688287800 x1873906083336576/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096264 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096248.737431:0:26009:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737439:0:26009:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff962691864800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096248.737443:0:26009:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096248.737461:0:26009:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:0.0:1787096248.737467:0:26009:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e6a 00000080:00010000:0.0:1787096248.737470:0:26009:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:0.0:1787096248.737473:0:26009:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e6a from it ffffa4118193bb58 00010000:00010000:0.0:1787096248.737476:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737483:0:26009:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096248.737512:0:26009:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096248.737522:0:26009:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), flags=8 00000080:00200000:0.0:1787096248.737526:0:26009:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), intent=getattr 00000002:00010000:0.0:1787096248.737538:0:26009:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096248.737554:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737564:0:26009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.737570:0:26009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26009 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096248.737582:0:26009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336704:192.168.204.135@tcp:101:rm.0 00000100:00100000:0.0:1787096248.737619:0:26009:0:(client.c:2692:ptlrpc_set_wait()) set ffff962691a1ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096248.738971:0:26009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336704:192.168.204.135@tcp:101:rm.0 00010000:00010000:0.0:1787096248.738982:0:26009:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.738994:0:26009:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739000:0:26009:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739005:0:26009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739012:0:26009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739018:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739034:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739039:0:26009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096248.739046:0:26009:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff962688287800 x1873906083336704/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096264 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096248.739053:0:26009:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739059:0:26009:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff962691864800 type 13 mode 4 res 8589935617/14 (0 0) 00000080:00200000:0.0:1787096248.739063:0:26009:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096248.739073:0:26009:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xe:0x0], updating i_size 0 00000080:00200000:0.0:1787096248.739076:0:26009:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0xe:0x0](ffff962690d2db88): rc = 0 00000080:00200000:0.0:1787096248.739117:0:26009:0:(file.c:6803:ll_layout_conf()) [0x200000401:0xe:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096248.739409:0:26009:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xe:0x0](ffff962690d2db88) for lock 0x6bbf6a0cc6be5e71 00000080:00010000:0.0:1787096248.739419:0:26009:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xe:0x0](ffff962690d2db88) 00000080:00010000:0.0:1787096248.739421:0:26009:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e71 from it ffffa4118193bb20 00010000:00010000:0.0:1787096248.739424:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096248.739432:0:26009:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787096248.739483:0:26009:0:(file.c:6271:ll_getattr_dentry()) START file f6b.sanity-ec:[0x200000401:0xe:0x0](ffff962690d2db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787096248.739490:0:26009:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xe:0x0](ffff962690d2db88),name=f6b.sanity-ec 00000002:00010000:1.0:1787096248.739504:0:26009:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096248.739512:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096248.739522:0:26009:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096248.739528:0:26009:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787096248.739532:0:26009:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xe:0x0](ffff962690d2db88) 00000080:00010000:1.0:1787096248.739535:0:26009:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xe:0x0](ffff962690d2db88) for lock 0x6bbf6a0cc6be5e71 00000080:00010000:1.0:1787096248.739539:0:26009:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e71 from it ffffa4118193bcb8 00010000:00010000:1.0:1787096248.739541:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096248.739547:0:26009:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096248.739581:0:26009:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:1.0:1787096248.739593:0:26009:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096248.739600:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096248.739606:0:26009:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096248.739610:0:26009:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787096248.739613:0:26009:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:1.0:1787096248.739615:0:26009:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e6a 00000080:00010000:1.0:1787096248.739618:0:26009:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e6a from it ffffa4118193bc10 00010000:00010000:1.0:1787096248.739620:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096248.739626:0:26009:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096248.739631:0:26009:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 1 00000080:00200000:1.0:1787096248.739637:0:26009:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6b.sanity-ec, flags=0 00000080:00200000:1.0:1787096248.739641:0:26009:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:1.0:1787096248.739644:0:26009:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096248.739647:0:26009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096248.739652:0:26009:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096248.739656:0:26009:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787096248.739659:0:26009:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:1.0:1787096248.739664:0:26009:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e6a 00000080:00010000:1.0:1787096248.739667:0:26009:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e6a from it ffffa4118193bd68 00010000:00010000:1.0:1787096248.739670:0:26009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096248.739675:0:26009:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787096248.739680:0:26009:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 3 00000080:00200000:1.0:1787096248.739684:0:26009:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348) 00010000:00010000:1.0:1787096248.739724:0:26009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787096248.739740:0:26009:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096248.739750:0:26009:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xe:0x0]: losing layout lock 00010000:00010000:1.0:1787096248.739770:0:26009:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096248.739791:0:26009:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787096248.739795:0:26009:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1787096248.739798:0:26009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680030200/0x6bbf6a0cc6be5e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xf4d1a9ae0b4f2ec6 expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096248.739811:0:26009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031000/0x6bbf6a0cc6be5e6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xf4d1a9ae0b4f2eaa expref: -99 pid: 26009 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1787096248.739832:0:26009:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff96268a49c800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787096248.739838:0:26009:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff962688281500 x1873906083336960/t0(0) o36->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787096248.739849:0:26009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688281500 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336960:192.168.204.135@tcp:36:rm.0 00000100:00100000:1.0:1787096248.739887:0:26009:0:(client.c:2692:ptlrpc_set_wait()) set ffff962690a80840 going to sleep for 11 seconds 00000100:00100000:3.0F:1787096248.742743:0:26009:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688281500 pname:cluuid:pid:xid:nid:opc:job rm:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26009:1873906083336960:192.168.204.135@tcp:36:rm.0 00000080:00200000:3.0:1787096248.742889:0:26009:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787096248.742902:0:26009:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787096248.742937:0:26009:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0xe:0x0](ffff962690d2db88) 00010000:00010000:0.0:1787096249.234239:0:5566:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096250.258200:0:5567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096251.235823:0:26290:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6c: EC with multiple data mirrors - parity never selected ========================================================== 19:37:30 (1787096250) 00010000:00010000:0.0:1787096251.282223:0:5566:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096251.740365:0:26427:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_6c needs >= 8 OSTs 00000001:02000400:0.0:1787096252.243863:0:26579:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6d: Manually mark parity mirror stale and resync ========================================================== 19:37:31 (1787096251) 00000080:00200000:0.0:1787096252.285740:0:26593:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:0.0:1787096252.285760:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096252.285810:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.285818:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.285826:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096252.285847:0:26593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337088:192.168.204.135@tcp:101:lfs.0 00000100:00100000:0.0:1787096252.285930:0:26593:0:(client.c:2692:ptlrpc_set_wait()) set ffff9626860ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096252.287202:0:26593:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337088:192.168.204.135@tcp:101:lfs.0 00010000:00010000:0.0:1787096252.287215:0:26593:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287223:0:26593:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287232:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287240:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287248:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287261:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287267:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096252.287276:0:26593:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff962688287800 x1873906083337088/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096268 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096252.287285:0:26593:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287293:0:26593:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff962691864800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096252.287297:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096252.287316:0:26593:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:0.0:1787096252.287320:0:26593:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e78 00000080:00010000:0.0:1787096252.287324:0:26593:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:0.0:1787096252.287327:0:26593:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e78 from it ffffa41181c1fb58 00010000:00010000:0.0:1787096252.287330:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287337:0:26593:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096252.287356:0:26593:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096252.287366:0:26593:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), flags=8 00000080:00200000:0.0:1787096252.287369:0:26593:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), intent=getattr 00000002:00010000:0.0:1787096252.287385:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096252.287404:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287409:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.287415:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096252.287424:0:26593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337216:192.168.204.135@tcp:101:lfs.0 00000100:00100000:0.0:1787096252.287463:0:26593:0:(client.c:2692:ptlrpc_set_wait()) set ffff9626860ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1787096252.288616:0:26593:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688287800 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337216:192.168.204.135@tcp:101:lfs.0 00010000:00010000:3.0:1787096252.288629:0:26593:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288640:0:26593:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288648:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288664:0:26593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288673:0:26593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288681:0:26593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962680031200 already unused, calling callback (ffffffffc19bcb70) 00010000:00010000:3.0:1787096252.288686:0:26593:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288693:0:26593:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288701:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288720:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096252.288734:0:26593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.288742:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031200/0x6bbf6a0cc6be5e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096252.288758:0:26593:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff962688287800 x1873906083337216/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096268 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096252.288766:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787096252.288780:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096252.288787:0:26593:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787096252.288792:0:26593:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e78 from it ffffa41181c1f930 00010000:00010000:3.0:1787096252.288795:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096252.288800:0:26593:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096252.288845:0:26593:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:3.0:1787096252.288861:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096252.288869:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096252.288878:0:26593:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096252.288895:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096252.288899:0:26593:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:3.0:1787096252.288901:0:26593:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e78 00000080:00010000:3.0:1787096252.288904:0:26593:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e78 from it ffffa41181c1fbf8 00010000:00010000:3.0:1787096252.288906:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096252.288911:0:26593:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096252.288918:0:26593:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 1 00000080:00200000:3.0:1787096252.288924:0:26593:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6d.sanity-ec, flags=777 00000080:00200000:3.0:1787096252.288927:0:26593:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348),name=/ 00000002:00010000:3.0:1787096252.288932:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096252.288936:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096252.288943:0:26593:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096252.288947:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096252.288949:0:26593:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) 00000080:00010000:3.0:1787096252.288951:0:26593:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff962690d2d348) for lock 0x6bbf6a0cc6be5e78 00000080:00010000:3.0:1787096252.288953:0:26593:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e78 from it ffffa41181c1fb38 00010000:00010000:3.0:1787096252.288955:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096252.288968:0:26593:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787096252.288974:0:26593:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff962690d2d348), inode mode 41ed mask 3 00000080:00200000:3.0:1787096252.288977:0:26593:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), file ffff9626861daf00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787096252.288983:0:26593:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), intent=open|creat 00000002:00010000:3.0:1787096252.288995:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x200000401:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787096252.289003:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096252.289028:0:26593:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096252.289033:0:26593:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096252.289035:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff962680031400/0x6bbf6a0cc6be5e78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xf4d1a9ae0b4f2ef0 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096252.289056:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.289060:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096252.289067:0:26593:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff96268a49c800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096252.289072:0:26593:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9626890f9880 x1873906083337472/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096252.289078:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096252.289095:0:26593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9626890f9880 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337472:192.168.204.135@tcp:101:lfs.0 00000100:00100000:3.0:1787096252.289496:0:26593:0:(client.c:2692:ptlrpc_set_wait()) set ffff962689ab2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096252.291479:0:26593:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9626890f9880 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337472:192.168.204.135@tcp:101:lfs.0 00010000:00010000:3.0:1787096252.291496:0:26593:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291524:0:26593:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291533:0:26593:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291543:0:26593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291554:0:26593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291566:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291646:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291655:0:26593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096252.291681:0:26593:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff9626890f9880 x1873906083337472/t4294967345(4294967345) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787096252.291690:0:26593:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9626890f9880 x1873906083337472/t4294967345(4294967345) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096252.291700:0:26593:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291724:0:26593:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff962691864800 type 13 mode 4 res 8589935617/15 (0 0) 00000080:00200000:3.0:1787096252.291731:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096252.291739:0:26593:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff962690d2d348), intent=open|creat 00000080:00200000:3.0:1787096252.291761:0:26593:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0xf:0x0](ffff962690da9148) 00000080:00200000:3.0:1787096252.291767:0:26593:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xf:0x0], updating i_size 0 00000080:00200000:3.0:1787096252.291842:0:26593:0:(file.c:6803:ll_layout_conf()) [0x200000401:0xf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096252.291852:0:26593:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0xf:0x0](ffff962690da9148) 00000080:00010000:3.0:1787096252.291855:0:26593:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xf:0x0](ffff962690da9148) for lock 0x6bbf6a0cc6be5e86 00000080:00010000:3.0:1787096252.291861:0:26593:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xf:0x0](ffff962690da9148) 00000080:00200008:3.0:1787096252.291869:0:26593:0:(file.c:1058:ll_file_open()) START file f6d.sanity-ec:[0x200000401:0xf:0x0](ffff962690da9148), flags 120501 00000002:00100000:3.0:1787096252.291887:0:26593:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9626890f9880 x1873906083337472/t4294967345(4294967345) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096268 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787096252.291920:0:26593:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x6bbf6a0cc6be5e86 from it ffff962683f47de0 00010000:00010000:3.0:1787096252.291925:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.291935:0:26593:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096252.291967:0:26593:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0xf:0x0](ffff962690da9148), inode mode 81a4 mask 40 00000080:00200000:3.0:1787096252.292084:0:26593:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0xf:0x0](ffff962690da9148), inode mode 81a4 mask 2 00000080:00200000:3.0:1787096252.292093:0:26593:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0xf:0x0](ffff962690da9148), xattr lov 00000002:00010000:3.0:1787096252.292109:0:26593:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787096252.292203:0:26593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096252.292210:0:26593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096252.292216:0:26593:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff96268a49c800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096252.292221:0:26593:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9626890f8a80 x1873906083337728/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096252.292227:0:26593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096252.292238:0:26593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9626890f8a80 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337728:192.168.204.135@tcp:101:lfs.0 00000100:00100000:3.0:1787096252.292361:0:26593:0:(client.c:2692:ptlrpc_set_wait()) set ffff962689ab2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096252.293471:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.135@tcp (source: 12345-192.168.204.135@tcp) 00000100:00100000:3.0:1787096252.293507:0:5558:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088594816 00000100:00100000:3.0:1787096252.293513:0:5558:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088594816 00000100:00100000:3.0:1787096252.293552:0:5558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.135@tcp, seq: 16 00000100:00100000:3.0:1787096252.293560:0:5558:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff962686059180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:8906:x1873906088594816:12345-192.168.204.135@tcp:104: 00010000:00010000:3.0:1787096252.293569:0:5558:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096252.293621:0:5558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096252.293637:0:5558:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff962686059180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:8906:x1873906088594816:12345-192.168.204.135@tcp:104: Request processed in 75us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096252.293645:0:5558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.135@tcp, seq: 16 00010000:00010000:0.0:1787096252.293650:0:5567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096252.293659:0:5567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293671:0:5567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96269212fa00 already unused, calling callback (ffffffffc19bcb70) 00010000:00010000:0.0:1787096252.293677:0:5567:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293687:0:5567:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293719:0:5567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096252.293755:0:5567:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xf:0x0]: losing layout lock 00010000:00010000:0.0:1787096252.293796:0:5567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293815:0:5567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096252.293851:0:5567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293858:0:5567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212fa00/0x6bbf6a0cc6be5e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xf4d1a9ae0b4f2f21 expref: -99 pid: 26593 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096252.293870:0:5567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096252.293871:0:5567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096252.293873:0:5567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096252.293882:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:2361:1873906083337856:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096252.295094:0:2361:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:2361:1873906083337856:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096252.295689:0:26593:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9626890f8a80 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083337728:192.168.204.135@tcp:101:lfs.0 00010000:00010000:0.0:1787096252.295713:0:26593:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295723:0:26593:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295730:0:26593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295737:0:26593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295745:0:26593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295760:0:26593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96269212f800 already unused, calling callback (ffffffffc19bcb70) 00010000:00010000:0.0:1787096252.295763:0:26593:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295769:0:26593:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295776:0:26593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295783:0:26593:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096252.295787:0:26593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096252.295795:0:26593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff96268a49c800 lock: ffff96269212f800/0x6bbf6a0cc6be5e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26593 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096252.295814:0:26593:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff9626890f8a80 x1873906083337728/t0(0) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096268 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096252.295823:0:26593:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1787096252.295827:0:26593:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1787096252.295978:0:26593:0:(file.c:448:ll_file_release()) START file f6d.sanity-ec:[0x200000401:0xf:0x0](ffff962690da9148), flags 100001 00000002:00100000:0.0:1787096252.296016:0:26593:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff9626890f9880 x1873906083337472/t4294967345(4294967345) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096268 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787096252.296028:0:26593:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff96268a49c800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787096252.296034:0:26593:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff962688285c00 x1873906083338112/t0(0) o35->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787096252.296051:0:26593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff962688285c00 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083338112:192.168.204.135@tcp:35:lfs.0 00000100:00100000:0.0:1787096252.296103:0:26593:0:(client.c:2692:ptlrpc_set_wait()) set ffff9626860eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096252.296910:0:26593:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff962688285c00 pname:cluuid:pid:xid:nid:opc:job lfs:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916:26593:1873906083338112:192.168.204.135@tcp:35:lfs.0 00000002:00100000:0.0:1787096252.296932:0:26593:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9626890f9880 x1873906083337472/t4294967345(4294967345) o101->lustre-MDT0000-mdc-ffff96268a49c800@192.168.204.135@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096268 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787096252.306317:0:5566:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096252.743723:0:26722:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6d: @@@@@@ FAIL: create EC file failed Debug log: 298 lines, 298 kept, 0 dropped, 0 bad.