00010000:00010000:3.0F:1787096250.486697:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1787096250.613682:0:2406:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4548a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2406:1873906077048960:192.168.201.152@tcp:400:kworker.0 00000100:00100000:0.0F:1787096250.613682:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b45488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5469a594-d695-447b-b0fa-7bef4580840e:2407:1873906077048832:192.168.201.152@tcp:400:kworker.0 00000100:00100000:0.0:1787096250.613788:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9858421-28a9-4744-99eb-72e5bedc52c4:2407:1873906077049088:192.168.201.152@tcp:400:kworker.0 00000100:00100000:0.0:1787096250.615043:0:2407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b45488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5469a594-d695-447b-b0fa-7bef4580840e:2407:1873906077048832:192.168.201.152@tcp:400:kworker.0 00000100:00100000:1.0:1787096250.615063:0:2406:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4548a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2406:1873906077048960:192.168.201.152@tcp:400:kworker.0 00010000:00080000:0.0:1787096250.615074:0:2407:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff972b4548bb80 x1873906077049088/t0(0) o400->lustre-MDT0001-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 224/224 e 0 to 0 dl 1787096266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096250.615088:0:2407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9858421-28a9-4744-99eb-72e5bedc52c4:2407:1873906077049088:192.168.201.152@tcp:400:kworker.0 00000080:00200000:0.0:1787096250.806667:0:26813:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096250.806689:0:26813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096250.806740:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.806749:0:26813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.806757:0:26813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096250.806778:0:26813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049216:192.168.201.152@tcp:101:rm.0 00000100:00100000:0.0:1787096250.806848:0:26813:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b50844a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096250.808289:0:26813:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049216:192.168.201.152@tcp:101:rm.0 00010000:00010000:0.0:1787096250.808304:0:26813:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808312:0:26813:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808330:0:26813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808338:0:26813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808346:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808351:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808357:0:26813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096250.808368:0:26813:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b48009c00 x1873906077049216/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096266 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096250.808381:0:26813:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808392:0:26813:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096250.808397:0:26813:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096250.808418:0:26813:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096250.808424:0:26813:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4102e 00000080:00010000:0.0:1787096250.808428:0:26813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096250.808430:0:26813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4102e from it ffffb38a41d6bb58 00010000:00010000:0.0:1787096250.808438:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808444:0:26813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096250.808462:0:26813:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096250.808471:0:26813:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:0.0:1787096250.808475:0:26813:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:0.0:1787096250.808487:0:26813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096250.808502:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808530:0:26813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.808539:0:26813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096250.808554:0:26813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049344:192.168.201.152@tcp:101:rm.0 00000100:00100000:0.0:1787096250.808590:0:26813:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b50844a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096250.809949:0:26813:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049344:192.168.201.152@tcp:101:rm.0 00010000:00010000:0.0:1787096250.809961:0:26813:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.809977:0:26813:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.809985:0:26813:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810000:0:26813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810009:0:26813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810020:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810027:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810035:0:26813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096250.810045:0:26813:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b48009c00 x1873906077049344/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096266 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096250.810055:0:26813:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810063:0:26813:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/15 (0 0) 00000080:00200000:0.0:1787096250.810068:0:26813:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096250.810079:0:26813:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xf:0x0], updating i_size 0 00000080:00200000:0.0:1787096250.810082:0:26813:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xf:0x0](ffff972b489d3248): rc = 0 00000080:00200000:0.0:1787096250.810119:0:26813:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096250.810160:0:26813:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) for lock 0x4ef7bc65b7b41035 00000080:00010000:0.0:1787096250.810175:0:26813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) 00000080:00010000:0.0:1787096250.810178:0:26813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41035 from it ffffb38a41d6bb20 00010000:00010000:0.0:1787096250.810182:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096250.810191:0:26813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787096250.810212:0:26813:0:(file.c:6271:ll_getattr_dentry()) START file f6d.sanity-ec:[0x200000402:0xf:0x0](ffff972b489d3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787096250.810217:0:26813:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248),name=f6d.sanity-ec 00000002:00010000:0.0:1787096250.810228:0:26813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096250.810236:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096250.810246:0:26813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096250.810252:0:26813:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096250.810256:0:26813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) 00000080:00010000:0.0:1787096250.810259:0:26813:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) for lock 0x4ef7bc65b7b41035 00000080:00010000:0.0:1787096250.810262:0:26813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41035 from it ffffb38a41d6bcb8 00010000:00010000:0.0:1787096250.810265:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096250.810273:0:26813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096250.810305:0:26813:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096250.810317:0:26813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096250.810324:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096250.810332:0:26813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096250.810338:0:26813:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096250.810342:0:26813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096250.810344:0:26813:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4102e 00000080:00010000:0.0:1787096250.810348:0:26813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4102e from it ffffb38a41d6bc10 00010000:00010000:0.0:1787096250.810350:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096250.810357:0:26813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096250.810365:0:26813:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096250.810371:0:26813:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6d.sanity-ec, flags=0 00000080:00200000:0.0:1787096250.810376:0:26813:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096250.810380:0:26813:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096250.810386:0:26813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096250.810393:0:26813:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096250.810399:0:26813:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096250.810402:0:26813:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096250.810409:0:26813:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4102e 00000080:00010000:0.0:1787096250.810413:0:26813:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4102e from it ffffb38a41d6bd68 00010000:00010000:0.0:1787096250.810417:0:26813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096250.810425:0:26813:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096250.810434:0:26813:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:0.0:1787096250.810439:0:26813:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348) 00010000:00010000:0.0:1787096250.810475:0:26813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096250.810496:0:26813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096250.810552:0:26813:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xf:0x0]: losing layout lock 00010000:00010000:0.0:1787096250.810583:0:26813:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096250.810591:0:26813:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096250.810597:0:26813:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787096250.810600:0:26813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b41035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d4f5 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096250.810615:0:26813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522000/0x4ef7bc65b7b4102e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d4d9 expref: -99 pid: 26813 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1787096250.810645:0:26813:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787096250.810652:0:26813:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48009c00 x1873906077049600/t0(0) o36->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096250.810669:0:26813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049600:192.168.201.152@tcp:36:rm.0 00000100:00100000:0.0:1787096250.810711:0:26813:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b50844a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096250.812032:0:26813:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:26813:1873906077049600:192.168.201.152@tcp:36:rm.0 00000080:00200000:0.0:1787096250.812077:0:26813:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787096250.812085:0:26813:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787096250.812099:0:26813:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248) 00000001:02000400:1.0:1787096251.416231:0:26958:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 19:37:30 (1787096250) 00000080:00200000:0.0:1787096251.463306:0:26973:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096251.463332:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096251.463393:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.463405:0:26973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.463415:0:26973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096251.463444:0:26973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077049728:192.168.201.152@tcp:101:lfs.0 00000100:00100000:0.0:1787096251.463913:0:26973:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b58aa5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096251.465107:0:26973:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff972b497ed000: committing for last_committed 4294967349 gen 1 00000100:00100000:0.0:1787096251.465163:0:26973:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077049728:192.168.201.152@tcp:101:lfs.0 00010000:00010000:0.0:1787096251.465180:0:26973:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465200:0:26973:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465213:0:26973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465225:0:26973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465236:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465242:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465248:0:26973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096251.465256:0:26973:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b48009500 x1873906077049728/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096267 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096251.465265:0:26973:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465272:0:26973:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096251.465276:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096251.465295:0:26973:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096251.465304:0:26973:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4103c 00000080:00010000:0.0:1787096251.465308:0:26973:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096251.465310:0:26973:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4103c from it ffffb38a41c2bb58 00010000:00010000:0.0:1787096251.465313:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465319:0:26973:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096251.465334:0:26973:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096251.465343:0:26973:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:0.0:1787096251.465346:0:26973:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:0.0:1787096251.465359:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096251.465384:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465392:0:26973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.465400:0:26973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096251.465417:0:26973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077049856:192.168.201.152@tcp:101:lfs.0 00000100:00100000:0.0:1787096251.465460:0:26973:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b58aa5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096251.466492:0:26973:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077049856:192.168.201.152@tcp:101:lfs.0 00010000:00010000:0.0:1787096251.466505:0:26973:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466536:0:26973:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466547:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466552:0:26973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466558:0:26973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466563:0:26973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b41523c00 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:0.0:1787096251.466566:0:26973:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466572:0:26973:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466577:0:26973:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466582:0:26973:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096251.466586:0:26973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466590:0:26973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523c00/0x4ef7bc65b7b41043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096251.466601:0:26973:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff972b48009500 x1873906077049856/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096267 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096251.466610:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787096251.466622:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.466636:0:26973:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787096251.466642:0:26973:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4103c from it ffffb38a41c2b930 00010000:00010000:0.0:1787096251.466644:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.466650:0:26973:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096251.466680:0:26973:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096251.466687:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096251.466692:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096251.466698:0:26973:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096251.466702:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096251.466705:0:26973:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096251.466707:0:26973:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4103c 00000080:00010000:0.0:1787096251.466709:0:26973:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4103c from it ffffb38a41c2bbf8 00010000:00010000:0.0:1787096251.466712:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096251.466717:0:26973:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096251.466733:0:26973:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096251.466738:0:26973:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=777 00000080:00200000:0.0:1787096251.466742:0:26973:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096251.466748:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096251.466752:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096251.466757:0:26973:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096251.466762:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096251.466765:0:26973:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096251.466767:0:26973:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b4103c 00000080:00010000:0.0:1787096251.466769:0:26973:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4103c from it ffffb38a41c2bb38 00010000:00010000:0.0:1787096251.466771:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096251.466778:0:26973:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787096251.466786:0:26973:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:0.0:1787096251.466792:0:26973:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), file ffff972b525d6a80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787096251.466800:0:26973:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000002:00010000:0.0:1787096251.466816:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x200000402:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787096251.466826:0:26973:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096251.466865:0:26973:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096251.466870:0:26973:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096251.466873:0:26973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522200/0x4ef7bc65b7b4103c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d51f expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787096251.466892:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.466896:0:26973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096251.466902:0:26973:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096251.466907:0:26973:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48009500 x1873906077050112/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096251.466914:0:26973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096251.466924:0:26973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050112:192.168.201.152@tcp:101:lfs.0 00000100:00100000:0.0:1787096251.466999:0:26973:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b58aa5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096251.468312:0:26973:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009500 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050112:192.168.201.152@tcp:101:lfs.0 00010000:00010000:0.0:1787096251.468323:0:26973:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468339:0:26973:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/0,1 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468354:0:26973:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/0,1 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468360:0:26973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468367:0:26973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468374:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468380:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468385:0:26973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096251.468392:0:26973:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff972b48009500 x1873906077050112/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096267 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787096251.468401:0:26973:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b48009500 x1873906077050112/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096267 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096251.468407:0:26973:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468413:0:26973:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/16 (0 0) 00000080:00200000:0.0:1787096251.468420:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096251.468426:0:26973:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000080:00200000:0.0:1787096251.468440:0:26973:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0x10:0x0](ffff972b489200c8) 00000080:00200000:0.0:1787096251.468444:0:26973:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x10:0x0], updating i_size 0 00000080:00200000:0.0:1787096251.468541:0:26973:0:(file.c:6803:ll_layout_conf()) [0x200000402:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096251.468559:0:26973:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0x10:0x0](ffff972b489200c8) 00000080:00010000:0.0:1787096251.468562:0:26973:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10:0x0](ffff972b489200c8) for lock 0x4ef7bc65b7b4104a 00000080:00010000:0.0:1787096251.468568:0:26973:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10:0x0](ffff972b489200c8) 00000080:00200008:0.0:1787096251.468577:0:26973:0:(file.c:1058:ll_file_open()) START file f6e.sanity-ec:[0x200000402:0x10:0x0](ffff972b489200c8), flags 120501 00000002:00100000:0.0:1787096251.468591:0:26973:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b48009500 x1873906077050112/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096267 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787096251.468621:0:26973:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4104a from it ffff972b467a54e0 00010000:00010000:0.0:1787096251.468625:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468632:0:26973:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096251.468644:0:26973:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x10:0x0](ffff972b489200c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787096251.468669:0:26973:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0x10:0x0](ffff972b489200c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787096251.468675:0:26973:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0x10:0x0](ffff972b489200c8), xattr lov 00000002:00010000:0.0:1787096251.468686:0:26973:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787096251.468710:0:26973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.468715:0:26973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096251.468730:0:26973:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787096251.468734:0:26973:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48009c00 x1873906077050368/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787096251.468740:0:26973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096251.468750:0:26973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050368:192.168.201.152@tcp:101:lfs.0 00000100:00100000:0.0:1787096251.468856:0:26973:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b58aa5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096251.469657:0:2400:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.152@tcp (source: 12345-192.168.201.152@tcp) 00000100:00100000:2.0F:1787096251.469722:0:6152:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084442240 00000100:00100000:2.0:1787096251.469737:0:6152:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084442240 00000100:00100000:2.0:1787096251.469851:0:6152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.152@tcp, seq: 17 00000100:00100000:2.0:1787096251.469864:0:6152:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff972b51209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:10275:x1873906084442240:12345-192.168.201.152@tcp:104: 00010000:00010000:2.0:1787096251.469877:0:6152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096251.469935:0:6152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096251.469943:0:6152:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff972b51209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:10275:x1873906084442240:12345-192.168.201.152@tcp:104: Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096251.469951:0:6152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.152@tcp, seq: 17 00010000:00010000:0.0:1787096251.469957:0:6161:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096251.469966:0:6161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.469978:0:6161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b41522c00 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:0.0:1787096251.469982:0:6161:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.469996:0:6161:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.470005:0:6161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096251.470035:0:6161:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x10:0x0]: losing layout lock 00010000:00010000:0.0:1787096251.470065:0:6161:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.470070:0:6161:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096251.470093:0:6161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 1/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.470099:0:6161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522c00/0x4ef7bc65b7b4104a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d550 expref: -99 pid: 26973 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096251.470114:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096251.470116:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096251.470117:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096251.470124:0:2407:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096251.470147:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9858421-28a9-4744-99eb-72e5bedc52c4:2407:1873906077050496:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096251.471008:0:2407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9858421-28a9-4744-99eb-72e5bedc52c4:2407:1873906077050496:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096251.471278:0:26973:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050368:192.168.201.152@tcp:101:lfs.0 00010000:00010000:0.0:1787096251.471288:0:26973:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471295:0:26973:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471300:0:26973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471305:0:26973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471310:0:26973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471314:0:26973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b41522e00 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:0.0:1787096251.471323:0:26973:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471328:0:26973:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471333:0:26973:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471337:0:26973:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787096251.471341:0:26973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096251.471345:0:26973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41522e00/0x4ef7bc65b7b41051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26973 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096251.471367:0:26973:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff972b48009c00 x1873906077050368/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096267 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787096251.471375:0:26973:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1787096251.471380:0:26973:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1787096251.471586:0:26973:0:(file.c:448:ll_file_release()) START file f6e.sanity-ec:[0x200000402:0x10:0x0](ffff972b489200c8), flags 100001 00000002:00100000:0.0:1787096251.471617:0:26973:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff972b48009500 x1873906077050112/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096267 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787096251.471632:0:26973:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787096251.471637:0:26973:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48009c00 x1873906077050752/t0(0) o35->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787096251.471650:0:26973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050752:192.168.201.152@tcp:35:lfs.0 00000100:00100000:0.0:1787096251.471692:0:26973:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b58aa5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096251.472706:0:26973:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48009c00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26973:1873906077050752:192.168.201.152@tcp:35:lfs.0 00000002:00100000:0.0:1787096251.472727:0:26973:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff972b48009500 x1873906077050112/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096267 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787096251.509992:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096251.939752:0:27103:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6e: @@@@@@ FAIL: create EC file failed Debug log: 296 lines, 296 kept, 0 dropped, 0 bad.