00000080:00200000:2.0F:1787096241.054257:0:24138:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:2.0:1787096241.054286:0:24138:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096241.054362:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096241.054374:0:24138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096241.054384:0:24138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096241.054411:0:24138:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb1880 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077041920:192.168.201.152@tcp:101:rm.0 00000100:00100000:2.0:1787096241.054483:0:24138:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b471ffa80 going to sleep for 11 seconds 00000100:00100000:3.0F:1787096241.056266:0:24138:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb1880 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077041920:192.168.201.152@tcp:101:rm.0 00010000:00010000:3.0:1787096241.056295:0:24138:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056323:0:24138:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056337:0:24138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056351:0:24138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056363:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056373:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056382:0:24138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096241.056394:0:24138:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b48cb1880 x1873906077041920/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096241.056408:0:24138:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056419:0:24138:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1787096241.056426:0:24138:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787096241.056454:0:24138:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1787096241.056462:0:24138:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f86 00000080:00010000:3.0:1787096241.056468:0:24138:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:3.0:1787096241.056472:0:24138:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f86 from it ffffb38a41d43b58 00010000:00010000:3.0:1787096241.056476:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056485:0:24138:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096241.056624:0:24138:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:3.0:1787096241.056641:0:24138:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:3.0:1787096241.056646:0:24138:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:3.0:1787096241.056663:0:24138:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096241.056693:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056703:0:24138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.056712:0:24138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096241.056734:0:24138:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b5120b800 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077042048:192.168.201.152@tcp:101:rm.0 00000100:00100000:3.0:1787096241.056787:0:24138:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b60e04180 going to sleep for 11 seconds 00000100:00100000:3.0:1787096241.058249:0:24138:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b5120b800 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077042048:192.168.201.152@tcp:101:rm.0 00010000:00010000:3.0:1787096241.058263:0:24138:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058292:0:24138:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058313:0:24138:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058323:0:24138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058333:0:24138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058345:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058353:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058361:0:24138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096241.058372:0:24138:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b5120b800 x1873906077042048/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096241.058383:0:24138:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058391:0:24138:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/11 (0 0) 00000080:00200000:3.0:1787096241.058400:0:24138:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096241.058411:0:24138:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xb:0x0], updating i_size 0 00000080:00200000:3.0:1787096241.058414:0:24138:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xb:0x0](ffff972b48923248): rc = 0 00000080:00200000:3.0:1787096241.058452:0:24138:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096241.058473:0:24138:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff972b48923248) for lock 0x4ef7bc65b7b40f8d 00000080:00010000:3.0:1787096241.058481:0:24138:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff972b48923248) 00000080:00010000:3.0:1787096241.058484:0:24138:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f8d from it ffffb38a41d43b20 00010000:00010000:3.0:1787096241.058488:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096241.058498:0:24138:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787096241.058575:0:24138:0:(file.c:6271:ll_getattr_dentry()) START file f5a.sanity-ec:[0x200000402:0xb:0x0](ffff972b48923248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787096241.058583:0:24138:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xb:0x0](ffff972b48923248),name=f5a.sanity-ec 00000002:00010000:3.0:1787096241.058595:0:24138:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xb:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096241.058605:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096241.058616:0:24138:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096241.058624:0:24138:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096241.058629:0:24138:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff972b48923248) 00000080:00010000:3.0:1787096241.058633:0:24138:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff972b48923248) for lock 0x4ef7bc65b7b40f8d 00000080:00010000:3.0:1787096241.058638:0:24138:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f8d from it ffffb38a41d43cb8 00010000:00010000:3.0:1787096241.058642:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096241.058662:0:24138:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096241.058706:0:24138:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:3.0:1787096241.058715:0:24138:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096241.058723:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096241.058734:0:24138:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096241.058740:0:24138:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096241.058745:0:24138:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:3.0:1787096241.058748:0:24138:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f86 00000080:00010000:3.0:1787096241.058755:0:24138:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f86 from it ffffb38a41d43c10 00010000:00010000:3.0:1787096241.058758:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096241.058766:0:24138:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096241.058776:0:24138:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:3.0:1787096241.058785:0:24138:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5a.sanity-ec, flags=0 00000080:00200000:3.0:1787096241.058789:0:24138:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:3.0:1787096241.058796:0:24138:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096241.058803:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096241.058817:0:24138:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096241.058824:0:24138:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096241.058829:0:24138:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:3.0:1787096241.058832:0:24138:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f86 00000080:00010000:3.0:1787096241.058836:0:24138:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f86 from it ffffb38a41d43d68 00010000:00010000:3.0:1787096241.058839:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096241.058848:0:24138:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096241.058858:0:24138:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:3.0:1787096241.058863:0:24138:0:(namei.c:2404:ll_unlink()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348) 00010000:00010000:3.0:1787096241.058904:0:24138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096241.058930:0:24138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096241.058953:0:24138:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xb:0x0]: losing layout lock 00010000:00010000:3.0:1787096241.058993:0:24138:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 1/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096241.059001:0:24138:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096241.059018:0:24138:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1787096241.059021:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b800/0x4ef7bc65b7b40f8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d28d expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096241.059036:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95e00/0x4ef7bc65b7b40f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d271 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1787096241.059052:0:24138:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787096241.059059:0:24138:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b5120b800 x1873906077042304/t0(0) o36->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096241.059075:0:24138:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b5120b800 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077042304:192.168.201.152@tcp:36:rm.0 00000100:00100000:3.0:1787096241.059117:0:24138:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b60e04180 going to sleep for 11 seconds 00000100:00100000:3.0:1787096241.060780:0:24138:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b5120b800 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:24138:1873906077042304:192.168.201.152@tcp:36:rm.0 00000080:00200000:3.0:1787096241.060839:0:24138:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787096241.060849:0:24138:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787096241.060876:0:24138:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xb:0x0](ffff972b48923248) 00010000:00010000:1.0F:1787096241.270590:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096241.578318:0:24284:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:37:21 (1787096241) 00000080:00200000:1.0:1787096241.628086:0:24299:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:1.0:1787096241.628109:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096241.628159:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.628170:0:24299:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.628181:0:24299:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096241.628208:0:24299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042432:192.168.201.152@tcp:101:lfs.0 00000100:00100000:1.0:1787096241.628309:0:24299:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096241.629681:0:24299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042432:192.168.201.152@tcp:101:lfs.0 00010000:00010000:1.0:1787096241.629697:0:24299:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629710:0:24299:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629723:0:24299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629735:0:24299:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629744:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629757:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629763:0:24299:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096241.629772:0:24299:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b4548aa00 x1873906077042432/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787096241.629781:0:24299:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629789:0:24299:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1787096241.629793:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787096241.629811:0:24299:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1787096241.629816:0:24299:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f94 00000080:00010000:1.0:1787096241.629820:0:24299:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:1.0:1787096241.629822:0:24299:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f94 from it ffffb38a41c23b58 00010000:00010000:1.0:1787096241.629825:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629831:0:24299:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096241.629846:0:24299:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:1.0:1787096241.629856:0:24299:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:1.0:1787096241.629859:0:24299:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:1.0:1787096241.629883:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096241.629902:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629907:0:24299:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.629911:0:24299:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096241.629922:0:24299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042560:192.168.201.152@tcp:101:lfs.0 00000100:00100000:1.0:1787096241.629959:0:24299:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096241.630950:0:24299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042560:192.168.201.152@tcp:101:lfs.0 00010000:00010000:1.0:1787096241.630958:0:24299:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630965:0:24299:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630970:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630974:0:24299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630979:0:24299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630983:0:24299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b82147a00 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:1.0:1787096241.630986:0:24299:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.630998:0:24299:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.631003:0:24299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.631007:0:24299:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787096241.631011:0:24299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.631015:0:24299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147a00/0x4ef7bc65b7b40f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096241.631024:0:24299:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff972b4548aa00 x1873906077042560/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787096241.631031:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787096241.631042:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096241.631049:0:24299:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787096241.631053:0:24299:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f94 from it ffffb38a41c23930 00010000:00010000:1.0:1787096241.631055:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096241.631060:0:24299:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096241.631098:0:24299:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:1.0:1787096241.631105:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096241.631110:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096241.631116:0:24299:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787096241.631120:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787096241.631123:0:24299:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:1.0:1787096241.631125:0:24299:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f94 00000080:00010000:1.0:1787096241.631128:0:24299:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f94 from it ffffb38a41c23bf8 00010000:00010000:1.0:1787096241.631130:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787096241.631144:0:24299:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787096241.631153:0:24299:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:1.0:1787096241.631158:0:24299:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5b.sanity-ec, flags=777 00000080:00200000:1.0:1787096241.631163:0:24299:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:1.0:1787096241.631171:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096241.631177:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787096241.631186:0:24299:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787096241.631206:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787096241.631211:0:24299:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:1.0:1787096241.631214:0:24299:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b40f94 00000080:00010000:1.0:1787096241.631218:0:24299:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40f94 from it ffffb38a41c23b38 00010000:00010000:1.0:1787096241.631221:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787096241.631227:0:24299:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787096241.631234:0:24299:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:1.0:1787096241.631238:0:24299:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), file ffff972b51dc6c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787096241.631244:0:24299:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000002:00010000:1.0:1787096241.631256:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787096241.631264:0:24299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787096241.631286:0:24299:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787096241.631305:0:24299:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096241.631308:0:24299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146200/0x4ef7bc65b7b40f94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d2b7 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787096241.631329:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.631342:0:24299:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787096241.631349:0:24299:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787096241.631355:0:24299:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b4548aa00 x1873906077042816/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787096241.631361:0:24299:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096241.631371:0:24299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042816:192.168.201.152@tcp:101:lfs.0 00000100:00100000:1.0:1787096241.631445:0:24299:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096241.633185:0:24299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4548aa00 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077042816:192.168.201.152@tcp:101:lfs.0 00010000:00010000:1.0:1787096241.633203:0:24299:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633223:0:24299:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633232:0:24299:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633241:0:24299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633251:0:24299:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633272:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633280:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633288:0:24299:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096241.633315:0:24299:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff972b4548aa00 x1873906077042816/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096257 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787096241.633328:0:24299:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b4548aa00 x1873906077042816/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096257 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787096241.633338:0:24299:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.633347:0:24299:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/12 (0 0) 00000080:00200000:1.0:1787096241.633352:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787096241.633359:0:24299:0:(namei.c:1619:ll_create_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000080:00200000:1.0:1787096241.633380:0:24299:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0xc:0x0](ffff972b4897f448) 00000080:00200000:1.0:1787096241.633385:0:24299:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xc:0x0], updating i_size 0 00000080:00200000:1.0:1787096241.633462:0:24299:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787096241.633478:0:24299:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0xc:0x0](ffff972b4897f448) 00000080:00010000:1.0:1787096241.633482:0:24299:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xc:0x0](ffff972b4897f448) for lock 0x4ef7bc65b7b40fa2 00000080:00010000:1.0:1787096241.633491:0:24299:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xc:0x0](ffff972b4897f448) 00000080:00200008:1.0:1787096241.633886:0:24299:0:(file.c:1058:ll_file_open()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff972b4897f448), flags 120501 00000002:00100000:1.0:1787096241.633991:0:24299:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b4548aa00 x1873906077042816/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096257 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787096241.634034:0:24299:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b40fa2 from it ffff972b508f68a0 00010000:00010000:1.0:1787096241.634039:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.634049:0:24299:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096241.634066:0:24299:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff972b4897f448), inode mode 81a4 mask 40 00000080:00200000:1.0:1787096241.634097:0:24299:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff972b4897f448), inode mode 81a4 mask 2 00000080:00200000:1.0:1787096241.634106:0:24299:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0xc:0x0](ffff972b4897f448), xattr lov 00000002:00010000:1.0:1787096241.634120:0:24299:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787096241.634151:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.634160:0:24299:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787096241.634168:0:24299:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787096241.634175:0:24299:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b45489880 x1873906077043072/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 1032/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787096241.634184:0:24299:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096241.634198:0:24299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b45489880 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077043072:192.168.201.152@tcp:101:lfs.0 00000100:00100000:1.0:1787096241.634352:0:24299:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096241.635869:0:2401:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.152@tcp (source: 12345-192.168.201.152@tcp) 00000100:00100000:2.0:1787096241.636381:0:6153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787096241.636398:0:6153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084437248 00000100:00100000:2.0:1787096241.636404:0:6153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084437248 00000100:00100000:2.0:1787096241.636457:0:6153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.152@tcp, seq: 13 00000100:00100000:2.0:1787096241.636470:0:6153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff972b50d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:8384:x1873906084437248:12345-192.168.201.152@tcp:104: 00010000:00010000:2.0:1787096241.636482:0:6153:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636579:0:6153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096241.636587:0:6153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff972b50d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:8384:x1873906084437248:12345-192.168.201.152@tcp:104: Request processed in 121us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096241.636597:0:6153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.152@tcp, seq: 13 00010000:00010000:2.0:1787096241.636654:0:6160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096241.636661:0:6160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636671:0:6160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b82146600 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:2.0:1787096241.636683:0:6160:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636693:0:6160:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636701:0:6160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096241.636742:0:6160:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xc:0x0]: losing layout lock 00010000:00010000:2.0:1787096241.636780:0:6160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636785:0:6160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096241.636805:0:6160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636814:0:6160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82146600/0x4ef7bc65b7b40fa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d2e8 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096241.636835:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096241.636838:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096241.636842:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096241.636855:0:2408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2408:1873906077043200:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787096241.637911:0:2408:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2408:1873906077043200:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787096241.638534:0:24299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b45489880 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077043072:192.168.201.152@tcp:101:lfs.0 00010000:00010000:1.0:1787096241.638551:0:24299:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638562:0:24299:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638570:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638578:0:24299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638585:0:24299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638592:0:24299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b82147e00 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:1.0:1787096241.638595:0:24299:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638602:0:24299:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638609:0:24299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638615:0:24299:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787096241.638620:0:24299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096241.638626:0:24299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b82147e00/0x4ef7bc65b7b40fa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24299 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096241.638659:0:24299:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff972b45489880 x1873906077043072/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 1032/608 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787096241.638671:0:24299:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:1.0:1787096241.638678:0:24299:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:1.0:1787096241.638910:0:24299:0:(file.c:448:ll_file_release()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff972b4897f448), flags 100001 00000002:00100000:1.0:1787096241.638946:0:24299:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff972b4548aa00 x1873906077042816/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096257 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787096241.638957:0:24299:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787096241.638963:0:24299:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b45489880 x1873906077043456/t0(0) o35->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787096241.638979:0:24299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b45489880 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077043456:192.168.201.152@tcp:35:lfs.0 00000100:00100000:1.0:1787096241.639026:0:24299:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096241.640431:0:24299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b45489880 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:24299:1873906077043456:192.168.201.152@tcp:35:lfs.0 00000002:00100000:1.0:1787096241.640448:0:24299:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff972b4548aa00 x1873906077042816/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096257 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000001:02000400:3.0:1787096242.114869:0:24429:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed 00010000:00010000:1.0:1787096242.293599:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 288 lines, 288 kept, 0 dropped, 0 bad.